2024-04-26T23:20:57.374 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T23:20:57.374 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs_python} --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311 -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/orig.config.yaml 2024-04-26T23:20:57.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:20:57.688 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311 branch: wip-rishabh-testing-20240426.111959 description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs_python} email: null first_in_suite: false job_id: '7675311' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: disabled: true install: ceph: extra_system_packages: deb: - python3-pytest rpm: - python3-pytest flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: disabled: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECypiMhzlZ9MqSitgmx1hZczrjFLHTKAjOedvVnrhbiBbTvQ0/PBniTWwgpgLNxSNTrUZvttS5i/UbVQHF/V8Q= smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDH0ZAMpSTmaRpnH7gb2q119fWEHliUitXaDJoRfb1WILdGZZ3plIsS95gWVIbfpcyXMjvkXcrulBhScuAs/9Y0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - workunit: clients: client.0: - fs/test_python.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T23:20:57.688 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T23:20:57.689 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T23:20:57.689 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T23:20:57.691 INFO:teuthology.task.internal:Checking packages... 2024-04-26T23:20:57.721 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T23:20:57.721 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T23:20:57.721 INFO:teuthology.packaging:ref: None 2024-04-26T23:20:57.721 INFO:teuthology.packaging:tag: None 2024-04-26T23:20:57.721 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T23:20:57.721 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:20:57.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T23:20:58.044 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T23:20:58.046 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T23:20:58.205 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T23:20:58.205 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T23:20:58.346 INFO:teuthology.task.internal:Saving configuration 2024-04-26T23:20:58.375 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T23:20:58.382 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:20:58.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:16:04.239083', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECypiMhzlZ9MqSitgmx1hZczrjFLHTKAjOedvVnrhbiBbTvQ0/PBniTWwgpgLNxSNTrUZvttS5i/UbVQHF/V8Q='} 2024-04-26T23:20:58.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:16:04.241350', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDH0ZAMpSTmaRpnH7gb2q119fWEHliUitXaDJoRfb1WILdGZZ3plIsS95gWVIbfpcyXMjvkXcrulBhScuAs/9Y0='} 2024-04-26T23:20:58.438 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T23:20:58.443 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T23:20:58.443 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-26T23:20:58.443 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T23:20:58.541 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1c82298f70>, signals=[15]) 2024-04-26T23:20:58.541 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T23:20:58.550 INFO:teuthology.task.internal:Opening connections... 2024-04-26T23:20:58.550 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T23:20:58.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:20:58.629 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-04-26T23:20:58.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:20:58.706 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T23:20:58.713 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-26T23:20:58.731 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-26T23:20:58.732 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-04-26T23:20:58.790 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T23:20:58.791 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T23:20:58.791 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T23:20:58.791 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-26T23:20:58.820 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-04-26T23:20:58.839 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-04-26T23:20:58.839 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-04-26T23:20:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T23:20:58.898 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-04-26T23:20:58.898 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T23:20:58.898 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T23:20:58.898 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T23:20:58.898 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-04-26T23:20:58.921 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T23:20:58.931 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T23:20:58.961 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T23:20:58.961 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:20:58.964 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:20:58.981 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T23:20:58.988 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T23:20:58.989 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:20:59.022 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:20:59.048 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T23:20:59.110 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T23:20:59.130 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T23:20:59.130 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T23:20:59.131 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:20:59.131 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:20:59.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:20:59.149 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:20:59.149 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:20:59.149 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T23:20:59.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:20:59.150 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:20:59.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:20:59.150 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-04-26T23:20:59.207 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-437.el9.x86_64 2024-04-26T23:20:59.207 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:20:59.207 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:20:59.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:20:59.211 INFO:teuthology.orchestra.run.smithi032.stdout:5.14.0-437.el9.x86_64 2024-04-26T23:20:59.211 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:20:59.211 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:20:59.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:20:59.354 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum upgrade -y linux-firmware 2024-04-26T23:20:59.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum upgrade -y linux-firmware 2024-04-26T23:21:01.512 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-26T23:21:01.719 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-26T23:21:03.321 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-26T23:21:04.015 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-26T23:21:07.630 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T23:21:08.196 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-26T23:21:09.106 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 16 kB 00:00 2024-04-26T23:21:09.939 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-26T23:21:11.001 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-26T23:21:16.183 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-04-26T23:21:18.311 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-04-26T23:21:18.312 INFO:teuthology.orchestra.run.smithi032.stdout:Nothing to do. 2024-04-26T23:21:18.313 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-04-26T23:21:18.403 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T23:21:18.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:21:18.544 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T23:21:18.544 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T23:21:18.547 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi032.front.sepia.ceph.com to complete... 2024-04-26T23:21:28.908 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:18 2024-04-26T23:21:31.619 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26 23:21:31 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T23:21:31.620 INFO:teuthology.orchestra.run.smithi032.stderr:FINISHED --2024-04-26 23:21:31-- 2024-04-26T23:21:31.620 INFO:teuthology.orchestra.run.smithi032.stderr:Total wall clock time: 13s 2024-04-26T23:21:31.620 INFO:teuthology.orchestra.run.smithi032.stderr:Downloaded: 1 files, 341M in 12s (27.4 MB/s) 2024-04-26T23:21:31.623 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T23:21:31.623 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T23:21:33.815 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying... ######################################## 2024-04-26T23:21:33.941 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing... ######################################## 2024-04-26T23:21:34.060 INFO:teuthology.orchestra.run.smithi032.stdout:Updating / installing... 2024-04-26T23:21:34.113 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-04-26T23:21:36.116 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-26T23:21:36.117 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-26T23:21:36.117 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-26T23:21:36.217 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T23:21:36.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:21:36.366 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T23:21:36.367 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T23:21:36.369 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-26T23:21:42.363 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T23:21:50.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26 23:21:50 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T23:21:50.171 INFO:teuthology.orchestra.run.smithi016.stderr:FINISHED --2024-04-26 23:21:50-- 2024-04-26T23:21:50.171 INFO:teuthology.orchestra.run.smithi016.stderr:Total wall clock time: 14s 2024-04-26T23:21:50.171 INFO:teuthology.orchestra.run.smithi016.stderr:Downloaded: 1 files, 341M in 13s (25.4 MB/s) 2024-04-26T23:21:50.173 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T23:21:50.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T23:21:52.374 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying... ######################################## 2024-04-26T23:21:52.546 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing... ######################################## 2024-04-26T23:21:52.653 INFO:teuthology.orchestra.run.smithi016.stdout:Updating / installing... 2024-04-26T23:22:00.984 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T23:22:22.278 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T23:22:22.278 DEBUG:teuthology.orchestra.run.smithi032:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T23:22:22.351 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:22:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:22:22.353 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:22:22.354 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:22:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:22:22.356 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:22:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:22:22.358 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T23:22:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:22:22.360 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:22:22.361 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:22:22.362 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:22:22.363 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:22:22.364 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T23:22:22.365 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:22:22.366 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T23:22:22.367 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T23:22:22.368 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:22:22.369 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:22:22.370 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T23:22:22.371 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:22:22.372 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:22:22.373 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:22:22.374 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:22:22.375 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:22:22.376 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:22:22.377 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:22:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:22:22.379 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:22:22.380 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:22:22.381 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:22:22.382 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:22:22.383 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:22:22.384 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:22:22.385 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:22:22.386 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:22:22.387 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:22:22.388 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T23:22:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:22:22.390 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:22:22.391 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:22:22.392 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:22:22.393 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:22:22.394 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:22:22.395 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:22:22.396 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T23:22:22.397 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:22:22.398 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:22:22.399 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T23:22:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T23:22:22.401 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T23:22:22.402 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T23:22:22.403 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T23:22:22.404 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T23:22:22.405 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:22:22.406 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T23:22:22.406 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:22:22.406 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T23:22:22.406 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:22:22.406 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T23:22:22.406 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:22:22.406 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:22:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:22:22.408 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T23:22:22.408 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:22:22.408 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:22:22.408 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:22:22.408 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T23:22:22.408 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T23:22:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:22:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:22:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T23:22:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T23:22:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:22:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T23:22:22.409 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:22:22.410 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T23:22:22.410 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T23:22:22.410 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:22:22.410 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T23:22:22.410 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:22:22.410 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:22:22.410 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T23:22:22.411 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:22:22.411 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T23:22:22.411 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:22:22.411 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T23:22:22.411 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:22:22.411 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:22:22.411 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:22:22.412 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T23:22:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:22:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:22:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:22:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:22:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T23:22:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T23:22:22.413 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T23:22:22.414 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:22:22.414 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T23:22:22.414 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:22:22.414 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T23:22:22.414 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:22:22.414 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:22:22.415 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T23:22:22.415 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:22:22.415 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:22:22.415 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:22:22.415 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:22:22.415 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T23:22:22.415 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T23:22:22.416 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T23:22:22.417 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:22:22.418 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:22:22.419 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:22:22.420 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:22:22.421 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:22:22.422 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:22:22.423 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:22:22.424 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:22:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T23:22:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:22:22.427 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:22:22.428 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:22:22.429 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:22:22.430 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T23:22:22.431 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:22:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:22:22.433 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:22:22.434 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:22:22.435 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:22:22.436 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T23:22:22.437 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:22:22.438 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T23:22:22.439 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:22:22.440 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:22:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T23:22:22.442 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:22:22.443 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:22:22.444 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:22:22.445 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:22:22.446 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:22:22.447 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T23:22:22.448 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:22:22.449 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:22:22.450 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:22:22.451 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:22:22.452 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T23:22:22.454 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T23:22:22.455 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T23:22:22.456 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:22:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:22:22.458 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:22:22.459 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:22:22.460 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:22:22.461 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T23:22:22.463 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T23:22:22.464 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:22:22.465 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:22:22.466 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T23:22:22.468 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:22:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:22:22.470 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:22:22.471 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:22:22.472 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:22:22.473 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:22:22.474 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:22:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:22:22.476 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:22:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T23:22:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T23:22:22.479 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:22:22.480 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:22:22.481 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:22:22.482 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:22:22.483 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:22:22.484 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:22:22.485 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:22:22.486 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:22:22.487 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:22:22.488 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:22:22.489 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:22:22.490 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:22:22.491 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:22:22.492 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:22:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:22:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:22:22.495 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:22:22.496 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:22:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:22:22.498 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:22:22.498 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:22:22.498 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:22:22.498 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:22:22.498 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:22:22.498 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T23:22:22.502 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:22.502 DEBUG:teuthology.orchestra.run.smithi032:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T23:22:22.524 INFO:teuthology.orchestra.run.smithi032.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T23:22:22.524 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T23:22:22.524 INFO:teuthology.orchestra.run.smithi032.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T23:22:22.524 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2024-04-26T23:22:22.524 INFO:teuthology.orchestra.run.smithi032.stdout:for file in vmlinuz System.map config; do 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout: fi 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout:done 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T23:22:22.525 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T23:22:22.526 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:22.526 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2024-04-26T23:22:22.526 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -qi grub2-tools 2024-04-26T23:22:22.608 INFO:teuthology.orchestra.run.smithi032.stdout:Name : grub2-tools 2024-04-26T23:22:22.608 INFO:teuthology.orchestra.run.smithi032.stdout:Epoch : 1 2024-04-26T23:22:22.608 INFO:teuthology.orchestra.run.smithi032.stdout:Version : 2.06 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Release : 68.el9 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: x86_64 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Group : Unspecified 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Size : 8264254 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:License : GPLv3+ 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Packager : builder@centos.org 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Vendor : CentOS 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T23:22:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Summary : Support tools for GRUB. 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout:Description : 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout:hardware devices. 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:22:22.610 INFO:teuthology.orchestra.run.smithi032.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T23:22:22.611 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T23:22:22.611 INFO:teuthology.task.kernel:Updating grub on smithi032 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:22.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T23:22:23.199 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-04-26T23:22:24.587 INFO:teuthology.orchestra.run.smithi032.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T23:22:24.628 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-04-26T23:22:24.630 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-04-26T23:22:24.651 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.79qdhU5l0h 2024-04-26T23:22:24.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.79qdhU5l0h 2024-04-26T23:22:24.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.79qdhU5l0h 2024-04-26T23:22:24.858 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.79qdhU5l0h is 6KB 2024-04-26T23:22:24.914 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.79qdhU5l0h 2024-04-26T23:22:24.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T23:22:24.991 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T23:22:24.991 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T23:22:24.991 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T23:22:24.991 INFO:teuthology.orchestra.run.smithi032.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T23:22:24.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:25.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2024-04-26T23:22:41.296 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T23:22:41.296 DEBUG:teuthology.orchestra.run.smithi016:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:22:41.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:22:41.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:22:41.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:22:41.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:22:41.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:22:41.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:22:41.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:22:41.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:22:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:22:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:22:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T23:22:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:22:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T23:22:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:22:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T23:22:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:22:41.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T23:22:41.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:22:41.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:22:41.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:22:41.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:22:41.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:22:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:22:41.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:22:41.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:22:41.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:22:41.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:22:41.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:22:41.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:22:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:22:41.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:22:41.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:22:41.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T23:22:41.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:22:41.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:22:41.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T23:22:41.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:22:41.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:22:41.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T23:22:41.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:22:41.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T23:22:41.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:22:41.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:22:41.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T23:22:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:22:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:22:41.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T23:22:41.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T23:22:41.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:22:41.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:22:41.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:22:41.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:22:41.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:22:41.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:22:41.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:22:41.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:22:41.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:22:41.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:22:41.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:22:41.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:22:41.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:22:41.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:22:41.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:22:41.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:22:41.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T23:22:41.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:22:41.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:22:41.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:22:41.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:22:41.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:22:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T23:22:41.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:22:41.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T23:22:41.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:22:41.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:22:41.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:22:41.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:22:41.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T23:22:41.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:22:41.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T23:22:41.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T23:22:41.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T23:22:41.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:22:41.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:22:41.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T23:22:41.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:22:41.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T23:22:41.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T23:22:41.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T23:22:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T23:22:41.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T23:22:41.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T23:22:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:22:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:22:41.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T23:22:41.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:22:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T23:22:41.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:22:41.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T23:22:41.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:22:41.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T23:22:41.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:22:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:22:41.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:22:41.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:22:41.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T23:22:41.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:22:41.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:22:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:22:41.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:22:41.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:22:41.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:22:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T23:22:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T23:22:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:22:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:22:41.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:22:41.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:22:41.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:22:41.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:22:41.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:22:41.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:22:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:22:41.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:22:41.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:22:41.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:22:41.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:22:41.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:22:41.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:22:41.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:22:41.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:22:41.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:22:41.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:22:41.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:22:41.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:22:41.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:22:41.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:22:41.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T23:22:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:22:41.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:22:41.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:22:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T23:22:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:22:41.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:22:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:22:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T23:22:41.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:22:41.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:22:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:22:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:22:41.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:22:41.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:22:41.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T23:22:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T23:22:41.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:22:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T23:22:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T23:22:41.500 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T23:22:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:22:41.502 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:22:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:22:41.504 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:22:41.505 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:22:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T23:22:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:22:41.508 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:22:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:22:41.510 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:22:41.511 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:22:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:22:41.513 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:22:41.514 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:22:41.515 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:22:41.516 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:22:41.517 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T23:22:41.518 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:22:41.519 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:22:41.520 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:22:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:22:41.522 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:22:41.523 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:22:41.524 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:22:41.525 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:22:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:22:41.527 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:22:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:22:41.529 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T23:22:41.530 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:22:41.531 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:22:41.532 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:22:41.533 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:22:41.534 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:22:41.535 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T23:22:41.536 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T23:22:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:22:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:22:41.539 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T23:22:41.543 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:41.543 DEBUG:teuthology.orchestra.run.smithi016:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:fi 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:for file in vmlinuz System.map config; do 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout: fi 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:done 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T23:22:41.568 INFO:teuthology.orchestra.run.smithi016.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout:fi 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout:fi 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:41.569 INFO:teuthology.orchestra.run.smithi016.stdout:fi 2024-04-26T23:22:41.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2024-04-26T23:22:41.645 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2024-04-26T23:22:41.645 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.06 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 68.el9 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Group : Unspecified 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 8264254 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : builder@centos.org 2024-04-26T23:22:41.646 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2024-04-26T23:22:41.647 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:22:41.648 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T23:22:41.648 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T23:22:41.649 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:41.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T23:22:42.255 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-26T23:22:43.678 INFO:teuthology.orchestra.run.smithi016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T23:22:43.718 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-26T23:22:43.720 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-26T23:22:43.735 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.kQPMAGxMH1 2024-04-26T23:22:43.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kQPMAGxMH1 2024-04-26T23:22:43.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.kQPMAGxMH1 2024-04-26T23:22:43.930 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.kQPMAGxMH1 is 6KB 2024-04-26T23:22:43.950 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.kQPMAGxMH1 2024-04-26T23:22:43.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T23:22:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T23:22:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T23:22:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T23:22:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T23:22:44.035 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T23:22:44.189 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-04-26T23:22:55.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T23:22:55.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-04-26T23:22:55.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:23:13.571 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-04-26T23:23:14.192 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T23:23:14.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T23:23:14.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:23:22.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-04-26T23:23:22.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:23:25.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-04-26T23:23:32.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-26T23:23:37.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-04-26T23:23:37.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:23:41.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T23:23:41.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:24:37.691 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T23:24:41.520 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T23:24:52.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-04-26T23:24:52.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:24:52.999 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-04-26T23:24:53.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T23:24:53.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:24:53.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-04-26T23:24:53.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:24:53.655 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-04-26T23:24:53.715 INFO:teuthology.orchestra.run.smithi032.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:24:53.716 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:24:53.716 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:24:53.716 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T23:24:53.891 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T23:24:54.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T23:24:54.516 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:24:54.516 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T23:24:54.572 INFO:teuthology.orchestra.run.smithi016.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:24:54.573 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:24:54.573 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:24:54.573 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T23:24:54.717 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T23:24:54.717 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T23:24:54.849 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2024-04-26T23:24:54.902 DEBUG:teuthology.parallel:result is None 2024-04-26T23:24:55.574 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T23:24:55.574 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T23:24:55.707 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-04-26T23:24:55.766 DEBUG:teuthology.parallel:result is None 2024-04-26T23:24:55.767 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T23:24:55.775 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T23:24:55.775 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:24:55.783 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:24:55.843 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T23:24:55.855 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T23:24:55.877 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T23:24:55.877 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:24:55.885 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:24:55.954 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T23:24:55.961 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T23:24:55.961 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:24:55.968 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:24:56.058 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:24:56.062 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:24:56.092 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:24:56.096 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:24:56.101 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T23:24:56.108 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T23:24:56.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:24:56.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:24:56.205 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T23:24:56.215 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T23:24:56.215 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:24:56.223 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:24:56.283 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:24:56.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:24:56.469 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:24:56.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:24:56.655 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:24:56.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:24:56.754 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:24:56.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:24:56.960 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:24:57.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:24:57.146 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:24:57.146 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:24:57.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-04-26T23:24:57.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-04-26T23:24:57.353 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T23:24:57.406 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T23:24:57.723 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T23:24:57.731 INFO:teuthology.task.internal:Starting timer... 2024-04-26T23:24:57.732 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T23:24:57.764 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T23:24:57.812 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T23:24:57.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-04-26T23:24:57.945 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-04-26T23:24:57.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo service auditd rotate 2024-04-26T23:24:58.111 INFO:teuthology.orchestra.run.smithi032.stdout:Rotating logs: 2024-04-26T23:24:58.117 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T23:24:58.117 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-04-26T23:24:58.183 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-04-26T23:24:58.183 DEBUG:teuthology.orchestra.run.smithi032:> /usr/sbin/getenforce 2024-04-26T23:24:58.240 INFO:teuthology.orchestra.run.smithi032.stdout:Permissive 2024-04-26T23:24:58.240 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi032.front.sepia.ceph.com': 'permissive'} 2024-04-26T23:24:58.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T23:24:58.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:24:58.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T23:24:58.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:24:58.408 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T23:24:58.408 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-04-26T23:24:58.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo /usr/sbin/setenforce permissive 2024-04-26T23:24:58.560 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T23:24:58.569 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T23:24:58.592 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T23:24:58.594 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi032.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T23:31:04.382 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi032.front.sepia.ceph.com')] 2024-04-26T23:31:04.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T23:31:04.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:31:04.496 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T23:31:04.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T23:31:04.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-04-26T23:31:04.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:31:04.770 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-04-26T23:31:04.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-04-26T23:31:04.932 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T23:31:04.943 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T23:31:04.943 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:31:04.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:31:04.951 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:31:04.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:31:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T23:31:05.049 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T23:31:05.086 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T23:31:05.093 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T23:31:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-04-26T23:31:05.171 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: ntpd: command not found 2024-04-26T23:31:05.193 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-04-26T23:31:05.206 INFO:teuthology.orchestra.run.smithi032.stdout:506 Cannot talk to daemon 2024-04-26T23:31:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T23:31:05.251 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T23:31:05.276 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T23:31:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T23:31:05.416 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-04-26T23:31:05.425 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T23:31:05.426 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-04-26T23:31:05.426 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.426 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.426 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.426 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.437 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 1: ntpq: command not found 2024-04-26T23:31:05.446 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T23:31:05.446 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2024-04-26T23:31:05.446 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.446 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.446 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.447 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:31:05.448 INFO:teuthology.run_tasks:Running task install... 2024-04-26T23:31:05.462 DEBUG:teuthology.task.install:project ceph 2024-04-26T23:31:05.462 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': {'deb': ['python3-pytest'], 'rpm': ['python3-pytest']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T23:31:05.462 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T23:31:05.462 INFO:teuthology.task.install:Using flavor: default 2024-04-26T23:31:05.475 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T23:31:05.475 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T23:31:05.476 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T23:31:05.477 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:31:05.480 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T23:31:05.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:31:05.624 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T23:31:05.624 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T23:31:05.694 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T23:31:05.694 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T23:31:05.804 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T23:31:05.804 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:31:05.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T23:31:05.806 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T23:31:05.806 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:31:05.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T23:31:05.900 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest on remote rpm x86_64 2024-04-26T23:31:05.900 DEBUG:teuthology.orchestra.run.smithi032:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T23:31:05.902 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, python3-pytest on remote rpm x86_64 2024-04-26T23:31:05.902 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T23:31:06.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T23:31:06.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T23:31:06.156 DEBUG:teuthology.orchestra.run.smithi032:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T23:31:06.158 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T23:31:06.238 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2024-04-26T23:31:06.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2024-04-26T23:31:06.244 INFO:teuthology.orchestra.run.smithi032.stdout:check_obsoletes = 1 2024-04-26T23:31:06.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum clean all 2024-04-26T23:31:06.581 INFO:teuthology.orchestra.run.smithi016.stdout:48 files removed 2024-04-26T23:31:06.584 INFO:teuthology.orchestra.run.smithi032.stdout:48 files removed 2024-04-26T23:31:06.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest 2024-04-26T23:31:06.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib python3-pytest 2024-04-26T23:31:07.684 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 135 kB/s | 84 kB 00:00 2024-04-26T23:31:08.048 INFO:teuthology.orchestra.run.smithi032.stdout:ceph packages for x86_64 86 kB/s | 84 kB 00:00 2024-04-26T23:31:08.443 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-04-26T23:31:08.966 INFO:teuthology.orchestra.run.smithi032.stdout:ceph noarch packages 14 kB/s | 12 kB 00:00 2024-04-26T23:31:09.318 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-04-26T23:31:09.749 INFO:teuthology.orchestra.run.smithi032.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-04-26T23:31:10.183 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-26T23:31:11.039 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-04-26T23:31:12.317 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-26T23:31:13.507 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-26T23:31:16.727 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-04-26T23:31:18.291 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-04-26T23:31:18.756 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-26T23:31:20.210 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T23:31:20.287 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-26T23:31:21.900 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-26T23:31:26.529 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-04-26T23:31:28.061 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-04-26T23:31:29.008 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:31:29.010 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:31:29.032 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T23:31:29.033 INFO:teuthology.orchestra.run.smithi016.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T23:31:29.035 INFO:teuthology.orchestra.run.smithi016.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T23:31:29.036 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T23:31:29.039 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T23:31:29.042 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T23:31:29.044 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T23:31:29.121 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-26T23:31:29.137 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-04-26T23:31:29.137 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T23:31:29.138 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T23:31:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T23:31:29.140 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T23:31:29.141 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T23:31:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:31:29.143 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T23:31:29.144 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T23:31:29.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T23:31:29.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T23:31:29.147 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T23:31:29.148 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T23:31:29.149 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout:Installing weak dependencies: 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout:Install 152 Packages 2024-04-26T23:31:29.150 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 4 Packages 2024-04-26T23:31:29.151 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:31:29.151 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 223 M 2024-04-26T23:31:29.151 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-26T23:31:30.139 INFO:teuthology.orchestra.run.smithi016.stdout:(1/156): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-26T23:31:30.389 INFO:teuthology.orchestra.run.smithi016.stdout:(2/156): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 3.5 MB/s | 889 kB 00:00 2024-04-26T23:31:30.464 INFO:teuthology.orchestra.run.smithi016.stdout:(3/156): ceph-immutable-object-cache-19.0.0-330 1.9 MB/s | 145 kB 00:00 2024-04-26T23:31:30.529 INFO:teuthology.orchestra.run.smithi032.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:31:30.530 INFO:teuthology.orchestra.run.smithi032.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:31:30.547 INFO:teuthology.orchestra.run.smithi032.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T23:31:30.548 INFO:teuthology.orchestra.run.smithi032.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T23:31:30.549 INFO:teuthology.orchestra.run.smithi032.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T23:31:30.550 INFO:teuthology.orchestra.run.smithi032.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T23:31:30.553 INFO:teuthology.orchestra.run.smithi032.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T23:31:30.556 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T23:31:30.557 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T23:31:30.632 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2024-04-26T23:31:30.649 INFO:teuthology.orchestra.run.smithi032.stdout:======================================================================================= 2024-04-26T23:31:30.649 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2024-04-26T23:31:30.649 INFO:teuthology.orchestra.run.smithi032.stdout:======================================================================================= 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T23:31:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T23:31:30.651 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2024-04-26T23:31:30.652 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T23:31:30.653 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T23:31:30.654 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T23:31:30.655 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T23:31:30.656 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T23:31:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2024-04-26T23:31:30.658 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T23:31:30.659 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T23:31:30.660 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout:Installing weak dependencies: 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout:======================================================================================= 2024-04-26T23:31:30.661 INFO:teuthology.orchestra.run.smithi032.stdout:Install 152 Packages 2024-04-26T23:31:30.662 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 4 Packages 2024-04-26T23:31:30.662 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:31:30.662 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 223 M 2024-04-26T23:31:30.662 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2024-04-26T23:31:30.840 INFO:teuthology.orchestra.run.smithi016.stdout:(4/156): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 5.5 MB/s | 5.4 MB 00:00 2024-04-26T23:31:30.932 INFO:teuthology.orchestra.run.smithi016.stdout:(5/156): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 5.1 MB/s | 2.4 MB 00:00 2024-04-26T23:31:31.024 INFO:teuthology.orchestra.run.smithi016.stdout:(6/156): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-04-26T23:31:31.624 INFO:teuthology.orchestra.run.smithi016.stdout:(7/156): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 6.8 MB/s | 4.7 MB 00:00 2024-04-26T23:31:32.069 INFO:teuthology.orchestra.run.smithi032.stdout:(1/156): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-04-26T23:31:32.350 INFO:teuthology.orchestra.run.smithi016.stdout:(8/156): ceph-common-19.0.0-3306.gbc612ffb.el9. 8.5 MB/s | 21 MB 00:02 2024-04-26T23:31:32.425 INFO:teuthology.orchestra.run.smithi016.stdout:(9/156): ceph-selinux-19.0.0-3306.gbc612ffb.el9 342 kB/s | 25 kB 00:00 2024-04-26T23:31:32.913 INFO:teuthology.orchestra.run.smithi032.stdout:(2/156): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.0 MB/s | 889 kB 00:00 2024-04-26T23:31:32.941 INFO:teuthology.orchestra.run.smithi016.stdout:(10/156): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 8.8 MB/s | 17 MB 00:01 2024-04-26T23:31:33.063 INFO:teuthology.orchestra.run.smithi032.stdout:(3/156): ceph-immutable-object-cache-19.0.0-330 975 kB/s | 145 kB 00:00 2024-04-26T23:31:33.358 INFO:teuthology.orchestra.run.smithi016.stdout:(11/156): ceph-radosgw-19.0.0-3306.gbc612ffb.el 6.1 MB/s | 11 MB 00:01 2024-04-26T23:31:33.392 INFO:teuthology.orchestra.run.smithi016.stdout:(12/156): cephfs-mirror-19.0.0-3306.gbc612ffb.e 500 kB/s | 225 kB 00:00 2024-04-26T23:31:33.442 INFO:teuthology.orchestra.run.smithi016.stdout:(13/156): cephfs-shell-19.0.0-3306.gbc612ffb.el 329 kB/s | 27 kB 00:00 2024-04-26T23:31:33.475 INFO:teuthology.orchestra.run.smithi016.stdout:(14/156): libcephfs-devel-19.0.0-3306.gbc612ffb 384 kB/s | 32 kB 00:00 2024-04-26T23:31:33.634 INFO:teuthology.orchestra.run.smithi016.stdout:(15/156): libcephfs2-19.0.0-3306.gbc612ffb.el9. 3.8 MB/s | 747 kB 00:00 2024-04-26T23:31:33.655 INFO:teuthology.orchestra.run.smithi032.stdout:(4/156): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-04-26T23:31:33.668 INFO:teuthology.orchestra.run.smithi016.stdout:(16/156): libcephsqlite-19.0.0-3306.gbc612ffb.e 852 kB/s | 163 kB 00:00 2024-04-26T23:31:33.701 INFO:teuthology.orchestra.run.smithi016.stdout:(17/156): librados-devel-19.0.0-3306.gbc612ffb. 1.9 MB/s | 127 kB 00:00 2024-04-26T23:31:34.060 INFO:teuthology.orchestra.run.smithi016.stdout:(18/156): libradosstriper1-19.0.0-3306.gbc612ff 1.2 MB/s | 501 kB 00:00 2024-04-26T23:31:34.106 INFO:teuthology.orchestra.run.smithi032.stdout:(5/156): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 3.4 MB/s | 1.5 MB 00:00 2024-04-26T23:31:34.144 INFO:teuthology.orchestra.run.smithi016.stdout:(19/156): python3-ceph-argparse-19.0.0-3306.gbc 549 kB/s | 45 kB 00:00 2024-04-26T23:31:34.231 INFO:teuthology.orchestra.run.smithi032.stdout:(6/156): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 2.0 MB/s | 2.4 MB 00:01 2024-04-26T23:31:34.286 INFO:teuthology.orchestra.run.smithi016.stdout:(20/156): python3-ceph-common-19.0.0-3306.gbc61 959 kB/s | 135 kB 00:00 2024-04-26T23:31:34.444 INFO:teuthology.orchestra.run.smithi016.stdout:(21/156): python3-cephfs-19.0.0-3306.gbc612ffb. 1.0 MB/s | 161 kB 00:00 2024-04-26T23:31:34.561 INFO:teuthology.orchestra.run.smithi016.stdout:(22/156): python3-rados-19.0.0-3306.gbc612ffb.e 2.7 MB/s | 321 kB 00:00 2024-04-26T23:31:34.664 INFO:teuthology.orchestra.run.smithi032.stdout:(7/156): ceph-common-19.0.0-3306.gbc612ffb.el9. 6.9 MB/s | 21 MB 00:03 2024-04-26T23:31:34.687 INFO:teuthology.orchestra.run.smithi016.stdout:(23/156): librgw2-19.0.0-3306.gbc612ffb.el9.x86 5.5 MB/s | 5.4 MB 00:00 2024-04-26T23:31:34.729 INFO:teuthology.orchestra.run.smithi016.stdout:(24/156): python3-rbd-19.0.0-3306.gbc612ffb.el9 1.8 MB/s | 298 kB 00:00 2024-04-26T23:31:34.762 INFO:teuthology.orchestra.run.smithi016.stdout:(25/156): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.3 MB/s | 99 kB 00:00 2024-04-26T23:31:34.846 INFO:teuthology.orchestra.run.smithi016.stdout:(26/156): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 736 kB/s | 85 kB 00:00 2024-04-26T23:31:34.954 INFO:teuthology.orchestra.run.smithi016.stdout:(27/156): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 1.6 MB/s | 171 kB 00:00 2024-04-26T23:31:35.055 INFO:teuthology.orchestra.run.smithi016.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3306.g 345 kB/s | 34 kB 00:00 2024-04-26T23:31:35.171 INFO:teuthology.orchestra.run.smithi016.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.2 MB/s | 142 kB 00:00 2024-04-26T23:31:35.248 INFO:teuthology.orchestra.run.smithi032.stdout:(8/156): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 4.1 MB/s | 4.7 MB 00:01 2024-04-26T23:31:35.348 INFO:teuthology.orchestra.run.smithi032.stdout:(9/156): ceph-selinux-19.0.0-3306.gbc612ffb.el9 254 kB/s | 25 kB 00:00 2024-04-26T23:31:35.547 INFO:teuthology.orchestra.run.smithi016.stdout:(30/156): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 3.9 MB/s | 3.1 MB 00:00 2024-04-26T23:31:36.249 INFO:teuthology.orchestra.run.smithi032.stdout:(10/156): ceph-radosgw-19.0.0-3306.gbc612ffb.el 6.7 MB/s | 11 MB 00:01 2024-04-26T23:31:36.332 INFO:teuthology.orchestra.run.smithi032.stdout:(11/156): cephfs-mirror-19.0.0-3306.gbc612ffb.e 2.7 MB/s | 225 kB 00:00 2024-04-26T23:31:36.416 INFO:teuthology.orchestra.run.smithi032.stdout:(12/156): cephfs-shell-19.0.0-3306.gbc612ffb.el 329 kB/s | 27 kB 00:00 2024-04-26T23:31:36.430 INFO:teuthology.orchestra.run.smithi016.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3306.gbc612 2.8 MB/s | 3.5 MB 00:01 2024-04-26T23:31:36.482 INFO:teuthology.orchestra.run.smithi032.stdout:(13/156): libcephfs-devel-19.0.0-3306.gbc612ffb 483 kB/s | 32 kB 00:00 2024-04-26T23:31:36.606 INFO:teuthology.orchestra.run.smithi016.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3306.gbc 1.4 MB/s | 249 kB 00:00 2024-04-26T23:31:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:(33/156): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 666 kB/s | 49 kB 00:00 2024-04-26T23:31:36.781 INFO:teuthology.orchestra.run.smithi016.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3306.gb 166 kB/s | 16 kB 00:00 2024-04-26T23:31:36.841 INFO:teuthology.orchestra.run.smithi032.stdout:(14/156): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 6.4 MB/s | 17 MB 00:02 2024-04-26T23:31:36.879 INFO:teuthology.orchestra.run.smithi016.stdout:(35/156): ceph-volume-19.0.0-3306.gbc612ffb.el9 2.8 MB/s | 273 kB 00:00 2024-04-26T23:31:36.883 INFO:teuthology.orchestra.run.smithi032.stdout:(15/156): libcephfs2-19.0.0-3306.gbc612ffb.el9. 1.8 MB/s | 747 kB 00:00 2024-04-26T23:31:36.917 INFO:teuthology.orchestra.run.smithi032.stdout:(16/156): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.2 MB/s | 163 kB 00:00 2024-04-26T23:31:36.950 INFO:teuthology.orchestra.run.smithi032.stdout:(17/156): librados-devel-19.0.0-3306.gbc612ffb. 1.9 MB/s | 127 kB 00:00 2024-04-26T23:31:37.009 INFO:teuthology.orchestra.run.smithi032.stdout:(18/156): libradosstriper1-19.0.0-3306.gbc612ff 5.4 MB/s | 501 kB 00:00 2024-04-26T23:31:37.101 INFO:teuthology.orchestra.run.smithi032.stdout:(19/156): python3-ceph-argparse-19.0.0-3306.gbc 497 kB/s | 45 kB 00:00 2024-04-26T23:31:37.107 INFO:teuthology.orchestra.run.smithi016.stdout:(36/156): cephadm-19.0.0-3306.gbc612ffb.el9.noa 3.3 MB/s | 762 kB 00:00 2024-04-26T23:31:37.174 INFO:teuthology.orchestra.run.smithi016.stdout:(37/156): cephfs-top-19.0.0-3306.gbc612ffb.el9. 277 kB/s | 18 kB 00:00 2024-04-26T23:31:37.176 INFO:teuthology.orchestra.run.smithi032.stdout:(20/156): python3-ceph-common-19.0.0-3306.gbc61 1.8 MB/s | 135 kB 00:00 2024-04-26T23:31:37.260 INFO:teuthology.orchestra.run.smithi032.stdout:(21/156): python3-cephfs-19.0.0-3306.gbc612ffb. 1.9 MB/s | 161 kB 00:00 2024-04-26T23:31:37.291 INFO:teuthology.orchestra.run.smithi016.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 694 kB/s | 80 kB 00:00 2024-04-26T23:31:37.360 INFO:teuthology.orchestra.run.smithi032.stdout:(22/156): python3-rados-19.0.0-3306.gbc612ffb.e 3.2 MB/s | 321 kB 00:00 2024-04-26T23:31:37.435 INFO:teuthology.orchestra.run.smithi032.stdout:(23/156): python3-rbd-19.0.0-3306.gbc612ffb.el9 3.9 MB/s | 298 kB 00:00 2024-04-26T23:31:37.466 INFO:teuthology.orchestra.run.smithi016.stdout:(39/156): ceph-mgr-diskprediction-local-19.0.0- 3.9 MB/s | 7.4 MB 00:01 2024-04-26T23:31:37.502 INFO:teuthology.orchestra.run.smithi032.stdout:(24/156): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.5 MB/s | 99 kB 00:00 2024-04-26T23:31:37.550 INFO:teuthology.orchestra.run.smithi016.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-26T23:31:37.586 INFO:teuthology.orchestra.run.smithi032.stdout:(25/156): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-26T23:31:37.608 INFO:teuthology.orchestra.run.smithi016.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-04-26T23:31:37.650 INFO:teuthology.orchestra.run.smithi016.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-26T23:31:37.717 INFO:teuthology.orchestra.run.smithi016.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-04-26T23:31:37.742 INFO:teuthology.orchestra.run.smithi016.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-04-26T23:31:37.776 INFO:teuthology.orchestra.run.smithi016.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-26T23:31:37.810 INFO:teuthology.orchestra.run.smithi016.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-26T23:31:37.843 INFO:teuthology.orchestra.run.smithi016.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-04-26T23:31:37.853 INFO:teuthology.orchestra.run.smithi032.stdout:(26/156): librgw2-19.0.0-3306.gbc612ffb.el9.x86 6.0 MB/s | 5.4 MB 00:00 2024-04-26T23:31:37.912 INFO:teuthology.orchestra.run.smithi032.stdout:(27/156): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.9 MB/s | 171 kB 00:00 2024-04-26T23:31:37.995 INFO:teuthology.orchestra.run.smithi032.stdout:(28/156): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 7.6 MB/s | 3.1 MB 00:00 2024-04-26T23:31:38.021 INFO:teuthology.orchestra.run.smithi032.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3306.g 317 kB/s | 34 kB 00:00 2024-04-26T23:31:38.071 INFO:teuthology.orchestra.run.smithi032.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.9 MB/s | 142 kB 00:00 2024-04-26T23:31:38.721 INFO:teuthology.orchestra.run.smithi032.stdout:(31/156): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-04-26T23:31:38.830 INFO:teuthology.orchestra.run.smithi032.stdout:(32/156): ceph-mgr-dashboard-19.0.0-3306.gbc612 4.4 MB/s | 3.5 MB 00:00 2024-04-26T23:31:38.863 INFO:teuthology.orchestra.run.smithi032.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3306.gbc 1.7 MB/s | 249 kB 00:00 2024-04-26T23:31:38.889 INFO:teuthology.orchestra.run.smithi032.stdout:(34/156): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 856 kB/s | 49 kB 00:00 2024-04-26T23:31:38.914 INFO:teuthology.orchestra.run.smithi032.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3306.gb 332 kB/s | 16 kB 00:00 2024-04-26T23:31:38.973 INFO:teuthology.orchestra.run.smithi032.stdout:(36/156): ceph-volume-19.0.0-3306.gbc612ffb.el9 3.2 MB/s | 273 kB 00:00 2024-04-26T23:31:39.023 INFO:teuthology.orchestra.run.smithi032.stdout:(37/156): cephadm-19.0.0-3306.gbc612ffb.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-26T23:31:39.048 INFO:teuthology.orchestra.run.smithi032.stdout:(38/156): cephfs-top-19.0.0-3306.gbc612ffb.el9. 245 kB/s | 18 kB 00:00 2024-04-26T23:31:39.190 INFO:teuthology.orchestra.run.smithi032.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 484 kB/s | 80 kB 00:00 2024-04-26T23:31:39.282 INFO:teuthology.orchestra.run.smithi032.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-26T23:31:39.327 INFO:teuthology.orchestra.run.smithi016.stdout:(48/156): ceph-test-19.0.0-3306.gbc612ffb.el9.x 7.1 MB/s | 49 MB 00:06 2024-04-26T23:31:39.332 INFO:teuthology.orchestra.run.smithi032.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-04-26T23:31:39.366 INFO:teuthology.orchestra.run.smithi032.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-26T23:31:39.369 INFO:teuthology.orchestra.run.smithi016.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 442 kB/s | 689 kB 00:01 2024-04-26T23:31:39.425 INFO:teuthology.orchestra.run.smithi032.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-26T23:31:39.484 INFO:teuthology.orchestra.run.smithi032.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-04-26T23:31:39.517 INFO:teuthology.orchestra.run.smithi032.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-04-26T23:31:39.567 INFO:teuthology.orchestra.run.smithi032.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-26T23:31:39.601 INFO:teuthology.orchestra.run.smithi032.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-26T23:31:39.753 INFO:teuthology.orchestra.run.smithi016.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 494 kB/s | 943 kB 00:01 2024-04-26T23:31:40.053 INFO:teuthology.orchestra.run.smithi016.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 31 kB/s | 21 kB 00:00 2024-04-26T23:31:40.078 INFO:teuthology.orchestra.run.smithi016.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 143 kB/s | 107 kB 00:00 2024-04-26T23:31:40.645 INFO:teuthology.orchestra.run.smithi016.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-04-26T23:31:40.803 INFO:teuthology.orchestra.run.smithi016.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 300 kB/s | 313 kB 00:01 2024-04-26T23:31:40.968 INFO:teuthology.orchestra.run.smithi032.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 492 kB/s | 689 kB 00:01 2024-04-26T23:31:41.254 INFO:teuthology.orchestra.run.smithi016.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 30 kB/s | 18 kB 00:00 2024-04-26T23:31:41.302 INFO:teuthology.orchestra.run.smithi032.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 555 kB/s | 943 kB 00:01 2024-04-26T23:31:41.362 INFO:teuthology.orchestra.run.smithi016.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-04-26T23:31:41.735 INFO:teuthology.orchestra.run.smithi032.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 140 kB/s | 107 kB 00:00 2024-04-26T23:31:41.919 INFO:teuthology.orchestra.run.smithi032.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 35 kB/s | 21 kB 00:00 2024-04-26T23:31:42.046 INFO:teuthology.orchestra.run.smithi016.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 66 kB/s | 45 kB 00:00 2024-04-26T23:31:42.163 INFO:teuthology.orchestra.run.smithi016.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 177 kB/s | 160 kB 00:00 2024-04-26T23:31:42.553 INFO:teuthology.orchestra.run.smithi032.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-04-26T23:31:42.736 INFO:teuthology.orchestra.run.smithi032.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 314 kB/s | 313 kB 00:00 2024-04-26T23:31:43.405 INFO:teuthology.orchestra.run.smithi016.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 469 kB/s | 582 kB 00:01 2024-04-26T23:31:43.463 INFO:teuthology.orchestra.run.smithi016.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 468 kB/s | 662 kB 00:01 2024-04-26T23:31:43.545 INFO:teuthology.orchestra.run.smithi032.stdout:(54/156): ceph-test-19.0.0-3306.gbc612ffb.el9.x 6.0 MB/s | 49 MB 00:08 2024-04-26T23:31:43.745 INFO:teuthology.orchestra.run.smithi032.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 18 kB/s | 18 kB 00:01 2024-04-26T23:31:43.997 INFO:teuthology.orchestra.run.smithi016.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 43 kB/s | 25 kB 00:00 2024-04-26T23:31:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-04-26T23:31:44.171 INFO:teuthology.orchestra.run.smithi032.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 18 kB/s | 11 kB 00:00 2024-04-26T23:31:44.473 INFO:teuthology.orchestra.run.smithi016.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 697 kB/s | 3.0 MB 00:04 2024-04-26T23:31:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 194 kB/s | 160 kB 00:00 2024-04-26T23:31:44.804 INFO:teuthology.orchestra.run.smithi032.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-04-26T23:31:44.998 INFO:teuthology.orchestra.run.smithi016.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 293 kB/s | 292 kB 00:00 2024-04-26T23:31:45.031 INFO:teuthology.orchestra.run.smithi016.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 204 kB/s | 188 kB 00:00 2024-04-26T23:31:45.098 INFO:teuthology.orchestra.run.smithi016.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 56 kB/s | 35 kB 00:00 2024-04-26T23:31:45.980 INFO:teuthology.orchestra.run.smithi032.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 471 kB/s | 662 kB 00:01 2024-04-26T23:31:46.113 INFO:teuthology.orchestra.run.smithi032.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 472 kB/s | 582 kB 00:01 2024-04-26T23:31:46.631 INFO:teuthology.orchestra.run.smithi032.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 39 kB/s | 25 kB 00:00 2024-04-26T23:31:46.739 INFO:teuthology.orchestra.run.smithi032.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-04-26T23:31:47.606 INFO:teuthology.orchestra.run.smithi016.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 649 kB/s | 1.6 MB 00:02 2024-04-26T23:31:47.631 INFO:teuthology.orchestra.run.smithi032.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 212 kB/s | 188 kB 00:00 2024-04-26T23:31:47.664 INFO:teuthology.orchestra.run.smithi032.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 283 kB/s | 292 kB 00:01 2024-04-26T23:31:48.156 INFO:teuthology.orchestra.run.smithi032.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 546 kB/s | 3.0 MB 00:05 2024-04-26T23:31:48.273 INFO:teuthology.orchestra.run.smithi032.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 55 kB/s | 35 kB 00:00 2024-04-26T23:31:49.215 INFO:teuthology.orchestra.run.smithi016.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 567 kB/s | 911 kB 00:01 2024-04-26T23:31:49.974 INFO:teuthology.orchestra.run.smithi016.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 176 kB/s | 133 kB 00:00 2024-04-26T23:31:50.599 INFO:teuthology.orchestra.run.smithi032.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 700 kB/s | 1.6 MB 00:02 2024-04-26T23:31:50.666 INFO:teuthology.orchestra.run.smithi016.stdout:(70/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 804 kB/s | 4.4 MB 00:05 2024-04-26T23:31:51.082 INFO:teuthology.orchestra.run.smithi016.stdout:(71/156): openblas-openmp-0.3.21-2.el9.x86_64.r 798 kB/s | 4.7 MB 00:06 2024-04-26T23:31:51.799 INFO:teuthology.orchestra.run.smithi016.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 123 kB/s | 87 kB 00:00 2024-04-26T23:31:52.315 INFO:teuthology.orchestra.run.smithi032.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 531 kB/s | 911 kB 00:01 2024-04-26T23:31:52.482 INFO:teuthology.orchestra.run.smithi016.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 569 kB/s | 1.0 MB 00:01 2024-04-26T23:31:53.074 INFO:teuthology.orchestra.run.smithi032.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 176 kB/s | 133 kB 00:00 2024-04-26T23:31:53.383 INFO:teuthology.orchestra.run.smithi016.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 272 kB/s | 244 kB 00:00 2024-04-26T23:31:53.757 INFO:teuthology.orchestra.run.smithi032.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 797 kB/s | 4.7 MB 00:06 2024-04-26T23:31:53.849 INFO:teuthology.orchestra.run.smithi032.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 796 kB/s | 4.4 MB 00:05 2024-04-26T23:31:53.909 INFO:teuthology.orchestra.run.smithi016.stdout:(75/156): python3-iniconfig-1.1.1-7.el9.noarch. 33 kB/s | 17 kB 00:00 2024-04-26T23:31:54.530 INFO:teuthology.orchestra.run.smithi032.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 129 kB/s | 87 kB 00:00 2024-04-26T23:31:54.775 INFO:teuthology.orchestra.run.smithi016.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 287 kB/s | 248 kB 00:00 2024-04-26T23:31:55.358 INFO:teuthology.orchestra.run.smithi016.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 44 kB/s | 26 kB 00:00 2024-04-26T23:31:55.433 INFO:teuthology.orchestra.run.smithi032.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 617 kB/s | 1.0 MB 00:01 2024-04-26T23:31:55.892 INFO:teuthology.orchestra.run.smithi016.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-04-26T23:31:56.400 INFO:teuthology.orchestra.run.smithi032.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 253 kB/s | 244 kB 00:00 2024-04-26T23:31:56.717 INFO:teuthology.orchestra.run.smithi016.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 209 kB/s | 172 kB 00:00 2024-04-26T23:31:56.933 INFO:teuthology.orchestra.run.smithi032.stdout:(75/156): python3-iniconfig-1.1.1-7.el9.noarch. 33 kB/s | 17 kB 00:00 2024-04-26T23:31:57.085 INFO:teuthology.orchestra.run.smithi016.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 832 kB/s | 5.8 MB 00:07 2024-04-26T23:31:57.418 INFO:teuthology.orchestra.run.smithi016.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 50 kB/s | 35 kB 00:00 2024-04-26T23:31:57.875 INFO:teuthology.orchestra.run.smithi032.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 264 kB/s | 248 kB 00:00 2024-04-26T23:31:58.318 INFO:teuthology.orchestra.run.smithi016.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 279 kB/s | 250 kB 00:00 2024-04-26T23:31:58.450 INFO:teuthology.orchestra.run.smithi032.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-04-26T23:31:59.159 INFO:teuthology.orchestra.run.smithi032.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 27 kB/s | 19 kB 00:00 2024-04-26T23:31:59.227 INFO:teuthology.orchestra.run.smithi016.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 822 kB/s | 6.0 MB 00:07 2024-04-26T23:31:59.260 INFO:teuthology.orchestra.run.smithi016.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 236 kB/s | 222 kB 00:00 2024-04-26T23:31:59.919 INFO:teuthology.orchestra.run.smithi016.stdout:(85/156): python3-pluggy-0.13.1-7.el9.noarch.rp 63 kB/s | 41 kB 00:00 2024-04-26T23:31:59.944 INFO:teuthology.orchestra.run.smithi016.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 108 kB/s | 77 kB 00:00 2024-04-26T23:32:00.034 INFO:teuthology.orchestra.run.smithi032.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 197 kB/s | 172 kB 00:00 2024-04-26T23:32:00.426 INFO:teuthology.orchestra.run.smithi032.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 805 kB/s | 5.8 MB 00:07 2024-04-26T23:32:00.586 INFO:teuthology.orchestra.run.smithi016.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 63 kB/s | 42 kB 00:00 2024-04-26T23:32:00.727 INFO:teuthology.orchestra.run.smithi032.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 50 kB/s | 35 kB 00:00 2024-04-26T23:32:00.886 INFO:teuthology.orchestra.run.smithi016.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 286 kB/s | 269 kB 00:00 2024-04-26T23:32:01.577 INFO:teuthology.orchestra.run.smithi032.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 295 kB/s | 250 kB 00:00 2024-04-26T23:32:01.653 INFO:teuthology.orchestra.run.smithi016.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-04-26T23:32:01.762 INFO:teuthology.orchestra.run.smithi016.stdout:(90/156): python3-py-1.10.0-6.el9.noarch.rpm 406 kB/s | 477 kB 00:01 2024-04-26T23:32:02.119 INFO:teuthology.orchestra.run.smithi032.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 805 kB/s | 6.0 MB 00:07 2024-04-26T23:32:02.453 INFO:teuthology.orchestra.run.smithi032.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 254 kB/s | 222 kB 00:00 2024-04-26T23:32:02.637 INFO:teuthology.orchestra.run.smithi016.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 284 kB/s | 279 kB 00:00 2024-04-26T23:32:02.786 INFO:teuthology.orchestra.run.smithi032.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 116 kB/s | 77 kB 00:00 2024-04-26T23:32:02.937 INFO:teuthology.orchestra.run.smithi016.stdout:(92/156): python3-pytest-6.2.2-7.el9.noarch.rpm 442 kB/s | 519 kB 00:01 2024-04-26T23:32:03.086 INFO:teuthology.orchestra.run.smithi032.stdout:(86/156): python3-pluggy-0.13.1-7.el9.noarch.rp 66 kB/s | 41 kB 00:00 2024-04-26T23:32:03.262 INFO:teuthology.orchestra.run.smithi016.stdout:(93/156): python3-pytz-2021.1-5.el9.noarch.rpm 82 kB/s | 51 kB 00:00 2024-04-26T23:32:03.395 INFO:teuthology.orchestra.run.smithi032.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-04-26T23:32:03.613 INFO:teuthology.orchestra.run.smithi016.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 800 kB/s | 5.1 MB 00:06 2024-04-26T23:32:03.646 INFO:teuthology.orchestra.run.smithi016.stdout:(95/156): python3-requests-oauthlib-1.3.0-12.el 76 kB/s | 54 kB 00:00 2024-04-26T23:32:03.978 INFO:teuthology.orchestra.run.smithi032.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 302 kB/s | 269 kB 00:00 2024-04-26T23:32:04.230 INFO:teuthology.orchestra.run.smithi016.stdout:(96/156): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-04-26T23:32:04.297 INFO:teuthology.orchestra.run.smithi016.stdout:(97/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 68 kB/s | 44 kB 00:00 2024-04-26T23:32:04.529 INFO:teuthology.orchestra.run.smithi032.stdout:(89/156): python3-py-1.10.0-6.el9.noarch.rpm 421 kB/s | 477 kB 00:01 2024-04-26T23:32:04.829 INFO:teuthology.orchestra.run.smithi032.stdout:(90/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 187 kB/s | 159 kB 00:00 2024-04-26T23:32:04.964 INFO:teuthology.orchestra.run.smithi016.stdout:(98/156): qatlib-service-24.02.0-1.el9.x86_64.r 54 kB/s | 36 kB 00:00 2024-04-26T23:32:05.114 INFO:teuthology.orchestra.run.smithi016.stdout:(99/156): qatlib-24.02.0-1.el9.x86_64.rpm 250 kB/s | 221 kB 00:00 2024-04-26T23:32:05.479 INFO:teuthology.orchestra.run.smithi032.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 294 kB/s | 279 kB 00:00 2024-04-26T23:32:05.615 INFO:teuthology.orchestra.run.smithi016.stdout:(100/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-04-26T23:32:06.021 INFO:teuthology.orchestra.run.smithi032.stdout:(92/156): python3-pytest-6.2.2-7.el9.noarch.rpm 436 kB/s | 519 kB 00:01 2024-04-26T23:32:06.121 INFO:teuthology.orchestra.run.smithi032.stdout:(93/156): python3-pytz-2021.1-5.el9.noarch.rpm 80 kB/s | 51 kB 00:00 2024-04-26T23:32:06.157 INFO:teuthology.orchestra.run.smithi016.stdout:(101/156): socat-1.7.4.1-5.el9.x86_64.rpm 293 kB/s | 305 kB 00:01 2024-04-26T23:32:06.257 INFO:teuthology.orchestra.run.smithi016.stdout:(102/156): uuid-1.6.2-55.el9.x86_64.rpm 90 kB/s | 58 kB 00:00 2024-04-26T23:32:06.714 INFO:teuthology.orchestra.run.smithi032.stdout:(94/156): python3-requests-oauthlib-1.3.0-12.el 78 kB/s | 54 kB 00:00 2024-04-26T23:32:06.856 INFO:teuthology.orchestra.run.smithi032.stdout:(95/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 812 kB/s | 5.1 MB 00:06 2024-04-26T23:32:06.924 INFO:teuthology.orchestra.run.smithi016.stdout:(103/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 122 kB/s | 94 kB 00:00 2024-04-26T23:32:06.958 INFO:teuthology.orchestra.run.smithi016.stdout:(104/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 91 kB/s | 64 kB 00:00 2024-04-26T23:32:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 272 kB/s | 22 kB 00:00 2024-04-26T23:32:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-04-26T23:32:07.475 INFO:teuthology.orchestra.run.smithi032.stdout:(96/156): python3-toml-0.10.2-6.el9.noarch.rpm 55 kB/s | 42 kB 00:00 2024-04-26T23:32:07.754 INFO:teuthology.orchestra.run.smithi016.stdout:(107/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 66 kB/s | 45 kB 00:00 2024-04-26T23:32:07.755 INFO:teuthology.orchestra.run.smithi032.stdout:(97/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 65 kB/s | 44 kB 00:00 2024-04-26T23:32:07.843 INFO:teuthology.orchestra.run.smithi016.stdout:(108/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-26T23:32:07.926 INFO:teuthology.orchestra.run.smithi016.stdout:(109/156): grpc-data-1.46.7-10.el9.noarch.rpm 235 kB/s | 19 kB 00:00 2024-04-26T23:32:08.068 INFO:teuthology.orchestra.run.smithi016.stdout:(110/156): gperftools-libs-2.9.1-2.el9.x86_64.r 675 kB/s | 309 kB 00:00 2024-04-26T23:32:08.140 INFO:teuthology.orchestra.run.smithi032.stdout:(98/156): qatlib-service-24.02.0-1.el9.x86_64.r 60 kB/s | 36 kB 00:00 2024-04-26T23:32:08.160 INFO:teuthology.orchestra.run.smithi016.stdout:(111/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 287 kB/s | 26 kB 00:00 2024-04-26T23:32:08.285 INFO:teuthology.orchestra.run.smithi016.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-26T23:32:08.310 INFO:teuthology.orchestra.run.smithi016.stdout:(113/156): liboath-2.6.7-2.el9.x86_64.rpm 325 kB/s | 49 kB 00:00 2024-04-26T23:32:08.332 INFO:teuthology.orchestra.run.smithi032.stdout:(99/156): qatlib-24.02.0-1.el9.x86_64.rpm 257 kB/s | 221 kB 00:00 2024-04-26T23:32:08.369 INFO:teuthology.orchestra.run.smithi016.stdout:(114/156): libunwind-1.6.2-1.el9.x86_64.rpm 816 kB/s | 67 kB 00:00 2024-04-26T23:32:08.402 INFO:teuthology.orchestra.run.smithi016.stdout:(115/156): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-26T23:32:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-04-26T23:32:08.561 INFO:teuthology.orchestra.run.smithi016.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-04-26T23:32:08.587 INFO:teuthology.orchestra.run.smithi016.stdout:(118/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 438 kB/s | 43 kB 00:00 2024-04-26T23:32:08.654 INFO:teuthology.orchestra.run.smithi016.stdout:(119/156): python3-cachetools-4.2.4-1.el9.noarc 354 kB/s | 32 kB 00:00 2024-04-26T23:32:08.679 INFO:teuthology.orchestra.run.smithi016.stdout:(120/156): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2024-04-26T23:32:08.746 INFO:teuthology.orchestra.run.smithi016.stdout:(121/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-04-26T23:32:08.757 INFO:teuthology.orchestra.run.smithi032.stdout:(100/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-04-26T23:32:08.788 INFO:teuthology.orchestra.run.smithi016.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-26T23:32:08.838 INFO:teuthology.orchestra.run.smithi016.stdout:(123/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.3 MB/s | 303 kB 00:00 2024-04-26T23:32:08.872 INFO:teuthology.orchestra.run.smithi016.stdout:(124/156): python3-colorama-0.4.4-12.el9.noarch 426 kB/s | 35 kB 00:00 2024-04-26T23:32:08.930 INFO:teuthology.orchestra.run.smithi016.stdout:(125/156): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-26T23:32:09.031 INFO:teuthology.orchestra.run.smithi016.stdout:(126/156): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-26T23:32:09.114 INFO:teuthology.orchestra.run.smithi016.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-04-26T23:32:09.140 INFO:teuthology.orchestra.run.smithi016.stdout:(128/156): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-04-26T23:32:09.198 INFO:teuthology.orchestra.run.smithi016.stdout:(129/156): python3-jaraco-classes-3.2.1-5.el9.n 214 kB/s | 18 kB 00:00 2024-04-26T23:32:09.223 INFO:teuthology.orchestra.run.smithi016.stdout:(130/156): python3-jaraco-collections-3.0.0-8.e 280 kB/s | 23 kB 00:00 2024-04-26T23:32:09.282 INFO:teuthology.orchestra.run.smithi016.stdout:(131/156): python3-jaraco-functools-3.5.0-2.el9 235 kB/s | 19 kB 00:00 2024-04-26T23:32:09.307 INFO:teuthology.orchestra.run.smithi016.stdout:(132/156): python3-jaraco-text-3.2.0-6.el9.noar 237 kB/s | 20 kB 00:00 2024-04-26T23:32:09.366 INFO:teuthology.orchestra.run.smithi032.stdout:(101/156): socat-1.7.4.1-5.el9.x86_64.rpm 318 kB/s | 305 kB 00:00 2024-04-26T23:32:09.402 INFO:teuthology.orchestra.run.smithi032.stdout:(102/156): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-04-26T23:32:09.416 INFO:teuthology.orchestra.run.smithi016.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-04-26T23:32:09.441 INFO:teuthology.orchestra.run.smithi016.stdout:(134/156): python3-logutils-0.3.5-21.el9.noarch 348 kB/s | 46 kB 00:00 2024-04-26T23:32:09.517 INFO:teuthology.orchestra.run.smithi016.stdout:(135/156): python3-more-itertools-8.12.0-2.el9. 792 kB/s | 79 kB 00:00 2024-04-26T23:32:09.542 INFO:teuthology.orchestra.run.smithi016.stdout:(136/156): python3-natsort-7.1.1-5.el9.noarch.r 579 kB/s | 58 kB 00:00 2024-04-26T23:32:09.635 INFO:teuthology.orchestra.run.smithi016.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-26T23:32:09.668 INFO:teuthology.orchestra.run.smithi016.stdout:(138/156): python3-portend-3.1.0-2.el9.noarch.r 132 kB/s | 16 kB 00:00 2024-04-26T23:32:09.726 INFO:teuthology.orchestra.run.smithi016.stdout:(139/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 997 kB/s | 90 kB 00:00 2024-04-26T23:32:09.760 INFO:teuthology.orchestra.run.smithi016.stdout:(140/156): python3-pyperclip-1.8.2-2.el9.noarch 310 kB/s | 28 kB 00:00 2024-04-26T23:32:09.810 INFO:teuthology.orchestra.run.smithi016.stdout:(141/156): python3-repoze-lru-0.7-16.el9.noarch 372 kB/s | 31 kB 00:00 2024-04-26T23:32:09.852 INFO:teuthology.orchestra.run.smithi016.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-26T23:32:09.902 INFO:teuthology.orchestra.run.smithi016.stdout:(143/156): python3-rsa-4.9-2.el9.noarch.rpm 649 kB/s | 59 kB 00:00 2024-04-26T23:32:09.936 INFO:teuthology.orchestra.run.smithi016.stdout:(144/156): python3-tempora-5.0.0-2.el9.noarch.r 431 kB/s | 36 kB 00:00 2024-04-26T23:32:09.986 INFO:teuthology.orchestra.run.smithi016.stdout:(145/156): python3-typing-extensions-4.4.0-2.el 616 kB/s | 51 kB 00:00 2024-04-26T23:32:10.028 INFO:teuthology.orchestra.run.smithi016.stdout:(146/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2024-04-26T23:32:10.075 INFO:teuthology.orchestra.run.smithi032.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 94 kB/s | 64 kB 00:00 2024-04-26T23:32:10.078 INFO:teuthology.orchestra.run.smithi016.stdout:(147/156): python3-websocket-client-1.2.3-2.el9 984 kB/s | 90 kB 00:00 2024-04-26T23:32:10.108 INFO:teuthology.orchestra.run.smithi032.stdout:(104/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 126 kB/s | 94 kB 00:00 2024-04-26T23:32:10.137 INFO:teuthology.orchestra.run.smithi016.stdout:(148/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2024-04-26T23:32:10.162 INFO:teuthology.orchestra.run.smithi016.stdout:(149/156): python3-zc-lockfile-2.0-10.el9.noarc 241 kB/s | 20 kB 00:00 2024-04-26T23:32:10.229 INFO:teuthology.orchestra.run.smithi016.stdout:(150/156): re2-20211101-3.el9.x86_64.rpm 2.1 MB/s | 192 kB 00:00 2024-04-26T23:32:10.234 INFO:teuthology.orchestra.run.smithi032.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 180 kB/s | 22 kB 00:00 2024-04-26T23:32:10.313 INFO:teuthology.orchestra.run.smithi016.stdout:(151/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T23:32:10.509 INFO:teuthology.orchestra.run.smithi032.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-04-26T23:32:10.705 INFO:teuthology.orchestra.run.smithi016.stdout:(152/156): librados2-19.0.0-3306.gbc612ffb.el9. 7.2 MB/s | 3.4 MB 00:00 2024-04-26T23:32:10.743 INFO:teuthology.orchestra.run.smithi032.stdout:(107/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-04-26T23:32:10.863 INFO:teuthology.orchestra.run.smithi016.stdout:(153/156): librbd1-19.0.0-3306.gbc612ffb.el9.x8 5.7 MB/s | 3.1 MB 00:00 2024-04-26T23:32:10.985 INFO:teuthology.orchestra.run.smithi032.stdout:(108/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-26T23:32:10.989 INFO:teuthology.orchestra.run.smithi016.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 4.8 MB/s | 1.3 MB 00:00 2024-04-26T23:32:11.077 INFO:teuthology.orchestra.run.smithi032.stdout:(109/156): grpc-data-1.46.7-10.el9.noarch.rpm 214 kB/s | 19 kB 00:00 2024-04-26T23:32:11.169 INFO:teuthology.orchestra.run.smithi032.stdout:(110/156): gperftools-libs-2.9.1-2.el9.x86_64.r 728 kB/s | 309 kB 00:00 2024-04-26T23:32:11.172 INFO:teuthology.orchestra.run.smithi016.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-04-26T23:32:11.261 INFO:teuthology.orchestra.run.smithi032.stdout:(111/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 286 kB/s | 26 kB 00:00 2024-04-26T23:32:11.353 INFO:teuthology.orchestra.run.smithi032.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 535 kB/s | 49 kB 00:00 2024-04-26T23:32:11.469 INFO:teuthology.orchestra.run.smithi032.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-26T23:32:11.495 INFO:teuthology.orchestra.run.smithi032.stdout:(114/156): libunwind-1.6.2-1.el9.x86_64.rpm 477 kB/s | 67 kB 00:00 2024-04-26T23:32:11.562 INFO:teuthology.orchestra.run.smithi032.stdout:(115/156): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-26T23:32:11.670 INFO:teuthology.orchestra.run.smithi032.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-04-26T23:32:11.721 INFO:teuthology.orchestra.run.smithi032.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-04-26T23:32:11.763 INFO:teuthology.orchestra.run.smithi032.stdout:(118/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 476 kB/s | 43 kB 00:00 2024-04-26T23:32:11.813 INFO:teuthology.orchestra.run.smithi032.stdout:(119/156): python3-cachetools-4.2.4-1.el9.noarc 353 kB/s | 32 kB 00:00 2024-04-26T23:32:11.884 INFO:teuthology.orchestra.run.smithi032.stdout:(120/156): python3-certifi-2021.10.8-2.el9.noar 124 kB/s | 15 kB 00:00 2024-04-26T23:32:11.922 INFO:teuthology.orchestra.run.smithi032.stdout:(121/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-04-26T23:32:11.981 INFO:teuthology.orchestra.run.smithi032.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 3.7 MB/s | 358 kB 00:00 2024-04-26T23:32:12.014 INFO:teuthology.orchestra.run.smithi032.stdout:(123/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-26T23:32:12.066 INFO:teuthology.orchestra.run.smithi032.stdout:(124/156): python3-colorama-0.4.4-12.el9.noarch 426 kB/s | 35 kB 00:00 2024-04-26T23:32:12.106 INFO:teuthology.orchestra.run.smithi032.stdout:(125/156): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-26T23:32:12.198 INFO:teuthology.orchestra.run.smithi032.stdout:(126/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-04-26T23:32:12.274 INFO:teuthology.orchestra.run.smithi032.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.8 MB/s | 2.0 MB 00:00 2024-04-26T23:32:12.299 INFO:teuthology.orchestra.run.smithi032.stdout:(128/156): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-04-26T23:32:12.366 INFO:teuthology.orchestra.run.smithi032.stdout:(129/156): python3-jaraco-classes-3.2.1-5.el9.n 194 kB/s | 18 kB 00:00 2024-04-26T23:32:12.391 INFO:teuthology.orchestra.run.smithi032.stdout:(130/156): python3-jaraco-collections-3.0.0-8.e 253 kB/s | 23 kB 00:00 2024-04-26T23:32:12.459 INFO:teuthology.orchestra.run.smithi032.stdout:(131/156): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2024-04-26T23:32:12.484 INFO:teuthology.orchestra.run.smithi032.stdout:(132/156): python3-jaraco-text-3.2.0-6.el9.noar 215 kB/s | 20 kB 00:00 2024-04-26T23:32:12.584 INFO:teuthology.orchestra.run.smithi032.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-04-26T23:32:12.609 INFO:teuthology.orchestra.run.smithi032.stdout:(134/156): python3-logutils-0.3.5-21.el9.noarch 372 kB/s | 46 kB 00:00 2024-04-26T23:32:12.676 INFO:teuthology.orchestra.run.smithi032.stdout:(135/156): python3-more-itertools-8.12.0-2.el9. 866 kB/s | 79 kB 00:00 2024-04-26T23:32:12.702 INFO:teuthology.orchestra.run.smithi032.stdout:(136/156): python3-natsort-7.1.1-5.el9.noarch.r 633 kB/s | 58 kB 00:00 2024-04-26T23:32:12.768 INFO:teuthology.orchestra.run.smithi032.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-26T23:32:12.794 INFO:teuthology.orchestra.run.smithi032.stdout:(138/156): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-04-26T23:32:12.861 INFO:teuthology.orchestra.run.smithi032.stdout:(139/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 985 kB/s | 90 kB 00:00 2024-04-26T23:32:12.886 INFO:teuthology.orchestra.run.smithi032.stdout:(140/156): python3-pyperclip-1.8.2-2.el9.noarch 309 kB/s | 28 kB 00:00 2024-04-26T23:32:12.953 INFO:teuthology.orchestra.run.smithi032.stdout:(141/156): python3-repoze-lru-0.7-16.el9.noarch 338 kB/s | 31 kB 00:00 2024-04-26T23:32:12.987 INFO:teuthology.orchestra.run.smithi032.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-26T23:32:13.045 INFO:teuthology.orchestra.run.smithi032.stdout:(143/156): python3-rsa-4.9-2.el9.noarch.rpm 649 kB/s | 59 kB 00:00 2024-04-26T23:32:13.071 INFO:teuthology.orchestra.run.smithi032.stdout:(144/156): python3-tempora-5.0.0-2.el9.noarch.r 430 kB/s | 36 kB 00:00 2024-04-26T23:32:13.146 INFO:teuthology.orchestra.run.smithi032.stdout:(145/156): python3-typing-extensions-4.4.0-2.el 512 kB/s | 51 kB 00:00 2024-04-26T23:32:13.180 INFO:teuthology.orchestra.run.smithi032.stdout:(146/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-26T23:32:13.247 INFO:teuthology.orchestra.run.smithi032.stdout:(147/156): python3-websocket-client-1.2.3-2.el9 903 kB/s | 90 kB 00:00 2024-04-26T23:32:13.305 INFO:teuthology.orchestra.run.smithi032.stdout:(148/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-26T23:32:13.356 INFO:teuthology.orchestra.run.smithi032.stdout:(149/156): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-04-26T23:32:13.414 INFO:teuthology.orchestra.run.smithi032.stdout:(150/156): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-26T23:32:13.848 INFO:teuthology.orchestra.run.smithi032.stdout:(151/156): librados2-19.0.0-3306.gbc612ffb.el9. 7.8 MB/s | 3.4 MB 00:00 2024-04-26T23:32:13.906 INFO:teuthology.orchestra.run.smithi032.stdout:(152/156): thrift-0.15.0-2.el9.x86_64.rpm 2.9 MB/s | 1.6 MB 00:00 2024-04-26T23:32:14.073 INFO:teuthology.orchestra.run.smithi032.stdout:(153/156): librbd1-19.0.0-3306.gbc612ffb.el9.x8 14 MB/s | 3.1 MB 00:00 2024-04-26T23:32:14.215 INFO:teuthology.orchestra.run.smithi032.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 4.4 MB/s | 1.3 MB 00:00 2024-04-26T23:32:14.466 INFO:teuthology.orchestra.run.smithi032.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.1 MB/s | 2.4 MB 00:00 2024-04-26T23:32:22.171 INFO:teuthology.orchestra.run.smithi016.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 880 kB/s | 16 MB 00:18 2024-04-26T23:32:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-26T23:32:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:Total 4.2 MB/s | 223 MB 00:53 2024-04-26T23:32:24.892 INFO:teuthology.orchestra.run.smithi032.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 887 kB/s | 16 MB 00:18 2024-04-26T23:32:24.899 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2024-04-26T23:32:24.899 INFO:teuthology.orchestra.run.smithi032.stdout:Total 4.1 MB/s | 223 MB 00:54 2024-04-26T23:32:25.293 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-26T23:32:25.558 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-26T23:32:25.558 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-26T23:32:28.022 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2024-04-26T23:32:28.258 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-26T23:32:28.259 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-26T23:32:28.294 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2024-04-26T23:32:28.294 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2024-04-26T23:32:31.062 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2024-04-26T23:32:31.063 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2024-04-26T23:32:34.718 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-26T23:32:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/160 2024-04-26T23:32:34.907 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/160 2024-04-26T23:32:35.031 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/160 2024-04-26T23:32:35.106 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/160 2024-04-26T23:32:35.149 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/160 2024-04-26T23:32:35.291 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/160 2024-04-26T23:32:35.743 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/160 2024-04-26T23:32:35.846 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/160 2024-04-26T23:32:36.024 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/160 2024-04-26T23:32:36.047 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/160 2024-04-26T23:32:36.175 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/160 2024-04-26T23:32:36.230 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/160 2024-04-26T23:32:36.638 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/160 2024-04-26T23:32:36.704 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/160 2024-04-26T23:32:36.735 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/160 2024-04-26T23:32:36.899 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/160 2024-04-26T23:32:36.936 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/160 2024-04-26T23:32:37.040 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/160 2024-04-26T23:32:37.070 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/160 2024-04-26T23:32:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/160 2024-04-26T23:32:37.444 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/160 2024-04-26T23:32:37.505 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/160 2024-04-26T23:32:37.587 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2024-04-26T23:32:37.698 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/160 2024-04-26T23:32:37.711 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/160 2024-04-26T23:32:37.773 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/160 2024-04-26T23:32:37.851 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/160 2024-04-26T23:32:37.876 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/160 2024-04-26T23:32:37.888 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/160 2024-04-26T23:32:37.934 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/160 2024-04-26T23:32:37.934 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/160 2024-04-26T23:32:37.967 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/160 2024-04-26T23:32:37.967 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 21/160 2024-04-26T23:32:38.019 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 22/160 2024-04-26T23:32:38.101 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/160 2024-04-26T23:32:38.124 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/160 2024-04-26T23:32:38.200 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/160 2024-04-26T23:32:38.245 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/160 2024-04-26T23:32:38.300 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/160 2024-04-26T23:32:38.371 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 27/160 2024-04-26T23:32:38.412 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/160 2024-04-26T23:32:38.444 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/160 2024-04-26T23:32:38.556 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/160 2024-04-26T23:32:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/160 2024-04-26T23:32:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/160 2024-04-26T23:32:38.656 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/160 2024-04-26T23:32:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/160 2024-04-26T23:32:38.731 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/160 2024-04-26T23:32:38.841 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/160 2024-04-26T23:32:38.863 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/160 2024-04-26T23:32:38.876 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 35/160 2024-04-26T23:32:38.883 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/160 2024-04-26T23:32:38.933 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 36/160 2024-04-26T23:32:38.967 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 37/160 2024-04-26T23:32:39.049 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/160 2024-04-26T23:32:39.087 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/160 2024-04-26T23:32:39.092 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/160 2024-04-26T23:32:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : luarocks-3.9.2-1.el9.noarch 39/160 2024-04-26T23:32:39.275 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/160 2024-04-26T23:32:39.449 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/160 2024-04-26T23:32:39.455 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/160 2024-04-26T23:32:39.525 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/160 2024-04-26T23:32:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/160 2024-04-26T23:32:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/160 2024-04-26T23:32:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/160 2024-04-26T23:32:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/160 2024-04-26T23:32:39.859 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/160 2024-04-26T23:32:39.889 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/160 2024-04-26T23:32:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/160 2024-04-26T23:32:40.232 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/160 2024-04-26T23:32:40.325 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/160 2024-04-26T23:32:40.351 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/160 2024-04-26T23:32:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/160 2024-04-26T23:32:40.411 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 45/160 2024-04-26T23:32:40.444 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 46/160 2024-04-26T23:32:40.479 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 47/160 2024-04-26T23:32:40.511 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 48/160 2024-04-26T23:32:40.566 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 49/160 2024-04-26T23:32:40.588 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/160 2024-04-26T23:32:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 50/160 2024-04-26T23:32:40.662 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 51/160 2024-04-26T23:32:40.710 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/160 2024-04-26T23:32:40.741 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 52/160 2024-04-26T23:32:40.757 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/160 2024-04-26T23:32:40.802 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/160 2024-04-26T23:32:40.830 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 21/160 2024-04-26T23:32:40.887 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 22/160 2024-04-26T23:32:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/160 2024-04-26T23:32:41.027 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 53/160 2024-04-26T23:32:41.097 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 54/160 2024-04-26T23:32:41.180 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 55/160 2024-04-26T23:32:41.210 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/160 2024-04-26T23:32:41.280 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 56/160 2024-04-26T23:32:41.284 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/160 2024-04-26T23:32:41.321 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 57/160 2024-04-26T23:32:41.361 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 58/160 2024-04-26T23:32:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/160 2024-04-26T23:32:41.440 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 27/160 2024-04-26T23:32:41.450 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 59/160 2024-04-26T23:32:41.486 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/160 2024-04-26T23:32:41.494 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 60/160 2024-04-26T23:32:41.525 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/160 2024-04-26T23:32:41.558 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 61/160 2024-04-26T23:32:41.623 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 62/160 2024-04-26T23:32:41.650 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/160 2024-04-26T23:32:41.727 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/160 2024-04-26T23:32:41.768 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/160 2024-04-26T23:32:41.839 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 63/160 2024-04-26T23:32:41.867 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/160 2024-04-26T23:32:41.891 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 64/160 2024-04-26T23:32:41.928 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 65/160 2024-04-26T23:32:41.988 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 66/160 2024-04-26T23:32:41.999 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/160 2024-04-26T23:32:42.039 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 35/160 2024-04-26T23:32:42.106 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 36/160 2024-04-26T23:32:42.132 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 67/160 2024-04-26T23:32:42.138 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 37/160 2024-04-26T23:32:42.186 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 68/160 2024-04-26T23:32:42.244 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/160 2024-04-26T23:32:42.262 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/160 2024-04-26T23:32:42.285 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 70/160 2024-04-26T23:32:42.318 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 71/160 2024-04-26T23:32:42.328 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : luarocks-3.9.2-1.el9.noarch 39/160 2024-04-26T23:32:42.441 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/160 2024-04-26T23:32:42.515 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/160 2024-04-26T23:32:42.624 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/160 2024-04-26T23:32:42.685 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/160 2024-04-26T23:32:42.711 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 73/160 2024-04-26T23:32:42.749 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/160 2024-04-26T23:32:42.796 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/160 2024-04-26T23:32:42.853 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 76/160 2024-04-26T23:32:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : uuid-1.6.2-55.el9.x86_64 77/160 2024-04-26T23:32:43.069 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/160 2024-04-26T23:32:43.255 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 79/160 2024-04-26T23:32:43.374 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-py-1.10.0-6.el9.noarch 80/160 2024-04-26T23:32:43.407 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/160 2024-04-26T23:32:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/160 2024-04-26T23:32:43.513 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/160 2024-04-26T23:32:43.598 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 45/160 2024-04-26T23:32:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/160 2024-04-26T23:32:43.629 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 46/160 2024-04-26T23:32:43.667 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 47/160 2024-04-26T23:32:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/160 2024-04-26T23:32:43.707 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 48/160 2024-04-26T23:32:43.764 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 49/160 2024-04-26T23:32:43.818 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 50/160 2024-04-26T23:32:43.846 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 84/160 2024-04-26T23:32:43.865 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 51/160 2024-04-26T23:32:43.916 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-04-26T23:32:43.945 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 52/160 2024-04-26T23:32:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 53/160 2024-04-26T23:32:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 54/160 2024-04-26T23:32:44.371 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 55/160 2024-04-26T23:32:44.473 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 56/160 2024-04-26T23:32:44.515 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 57/160 2024-04-26T23:32:44.555 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 58/160 2024-04-26T23:32:44.623 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 59/160 2024-04-26T23:32:44.681 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 60/160 2024-04-26T23:32:44.763 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 61/160 2024-04-26T23:32:44.829 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 62/160 2024-04-26T23:32:44.923 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/160 2024-04-26T23:32:44.982 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/160 2024-04-26T23:32:45.015 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/160 2024-04-26T23:32:45.039 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 63/160 2024-04-26T23:32:45.050 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/160 2024-04-26T23:32:45.094 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 64/160 2024-04-26T23:32:45.132 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 65/160 2024-04-26T23:32:45.192 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 66/160 2024-04-26T23:32:45.197 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 90/160 2024-04-26T23:32:45.241 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 91/160 2024-04-26T23:32:45.335 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 67/160 2024-04-26T23:32:45.381 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 68/160 2024-04-26T23:32:45.431 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 69/160 2024-04-26T23:32:45.472 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 70/160 2024-04-26T23:32:45.490 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.21-2.el9.x86_64 92/160 2024-04-26T23:32:45.506 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 71/160 2024-04-26T23:32:45.521 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 93/160 2024-04-26T23:32:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/160 2024-04-26T23:32:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 72/160 2024-04-26T23:32:45.911 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 73/160 2024-04-26T23:32:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 74/160 2024-04-26T23:32:45.993 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 75/160 2024-04-26T23:32:46.051 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 76/160 2024-04-26T23:32:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : uuid-1.6.2-55.el9.x86_64 77/160 2024-04-26T23:32:46.265 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 78/160 2024-04-26T23:32:46.442 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 79/160 2024-04-26T23:32:46.523 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/160 2024-04-26T23:32:46.559 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-py-1.10.0-6.el9.noarch 80/160 2024-04-26T23:32:46.620 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/160 2024-04-26T23:32:46.663 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/160 2024-04-26T23:32:46.674 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/160 2024-04-26T23:32:46.704 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/160 2024-04-26T23:32:46.848 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 84/160 2024-04-26T23:32:46.921 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-04-26T23:32:47.892 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/160 2024-04-26T23:32:47.945 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/160 2024-04-26T23:32:47.979 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/160 2024-04-26T23:32:48.013 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/160 2024-04-26T23:32:48.146 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 90/160 2024-04-26T23:32:48.196 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 91/160 2024-04-26T23:32:48.387 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/160 2024-04-26T23:32:48.458 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-0.3.21-2.el9.x86_64 92/160 2024-04-26T23:32:48.484 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 93/160 2024-04-26T23:32:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/160 2024-04-26T23:32:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/160 2024-04-26T23:32:48.583 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/160 2024-04-26T23:32:48.597 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 100/160 2024-04-26T23:32:49.011 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/160 2024-04-26T23:32:49.056 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 102/160 2024-04-26T23:32:49.180 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 102/160 2024-04-26T23:32:49.213 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/160 2024-04-26T23:32:49.288 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/160 2024-04-26T23:32:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/160 2024-04-26T23:32:49.587 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/160 2024-04-26T23:32:49.876 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/160 2024-04-26T23:32:49.918 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/160 2024-04-26T23:32:50.007 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/160 2024-04-26T23:32:50.036 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/160 2024-04-26T23:32:51.280 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/160 2024-04-26T23:32:51.375 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/160 2024-04-26T23:32:51.421 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/160 2024-04-26T23:32:51.469 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 100/160 2024-04-26T23:32:51.894 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/160 2024-04-26T23:32:51.938 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 102/160 2024-04-26T23:32:52.062 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 102/160 2024-04-26T23:32:52.086 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/160 2024-04-26T23:32:52.134 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/160 2024-04-26T23:32:52.751 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/160 2024-04-26T23:32:52.783 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/160 2024-04-26T23:32:52.813 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 108/160 2024-04-26T23:32:52.857 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 108/160 2024-04-26T23:32:52.884 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/160 2024-04-26T23:32:52.909 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/160 2024-04-26T23:32:53.546 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 108/160 2024-04-26T23:32:53.594 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/160 2024-04-26T23:32:53.770 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/160 2024-04-26T23:32:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T23:32:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T23:32:53.770 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:32:53.812 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/160 2024-04-26T23:32:55.746 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 108/160 2024-04-26T23:32:55.781 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 108/160 2024-04-26T23:32:56.485 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 108/160 2024-04-26T23:32:56.534 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/160 2024-04-26T23:32:56.691 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/160 2024-04-26T23:32:56.692 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T23:32:56.692 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T23:32:56.692 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:32:56.735 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/160 2024-04-26T23:33:06.799 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/160 2024-04-26T23:33:06.799 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2024-04-26T23:33:06.799 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2024-04-26T23:33:06.799 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2024-04-26T23:33:06.799 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2024-04-26T23:33:06.799 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2024-04-26T23:33:06.799 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /root 2024-04-26T23:33:06.800 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2024-04-26T23:33:06.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:07.026 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 111/160 2024-04-26T23:33:07.078 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 111/160 2024-04-26T23:33:07.078 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:07.078 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T23:33:07.078 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 112/160 2024-04-26T23:33:08.870 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 112/160 2024-04-26T23:33:08.870 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:08.870 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T23:33:08.870 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:33:08.870 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:33:08.870 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:09.129 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 113/160 2024-04-26T23:33:09.227 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 113/160 2024-04-26T23:33:09.227 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:09.227 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T23:33:09.227 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:33:09.227 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:33:09.227 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:09.738 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 114/160 2024-04-26T23:33:09.834 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 114/160 2024-04-26T23:33:09.834 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:09.835 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T23:33:09.835 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:33:09.835 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:33:09.835 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:09.973 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : automake-1.16.2-8.el9.noarch 115/160 2024-04-26T23:33:10.037 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/160 2024-04-26T23:33:10.113 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/160 2024-04-26T23:33:10.361 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/160 2024-04-26T23:33:10.428 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/160 2024-04-26T23:33:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/160 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /sys 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /proc 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /mnt 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /var/tmp 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /home 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /root 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /tmp 2024-04-26T23:33:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:10.527 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/160 2024-04-26T23:33:10.636 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/160 2024-04-26T23:33:10.726 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 111/160 2024-04-26T23:33:10.776 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 111/160 2024-04-26T23:33:10.776 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:10.776 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T23:33:10.776 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/160 2024-04-26T23:33:10.869 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/160 2024-04-26T23:33:10.909 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/160 2024-04-26T23:33:10.945 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.9-15.el9.x86_64 125/160 2024-04-26T23:33:11.626 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 126/160 2024-04-26T23:33:11.661 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 126/160 2024-04-26T23:33:11.718 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 127/160 2024-04-26T23:33:11.830 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 128/160 2024-04-26T23:33:11.854 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 129/160 2024-04-26T23:33:12.488 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 112/160 2024-04-26T23:33:12.570 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 112/160 2024-04-26T23:33:12.571 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:12.571 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T23:33:12.571 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:33:12.571 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:33:12.571 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 113/160 2024-04-26T23:33:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 113/160 2024-04-26T23:33:12.945 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:12.945 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T23:33:12.945 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:33:12.945 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:33:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:13.223 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 129/160 2024-04-26T23:33:13.265 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 130/160 2024-04-26T23:33:13.472 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 114/160 2024-04-26T23:33:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 114/160 2024-04-26T23:33:13.543 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:13.543 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T23:33:13.543 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:33:13.544 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:33:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:13.681 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : automake-1.16.2-8.el9.noarch 115/160 2024-04-26T23:33:13.745 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/160 2024-04-26T23:33:13.822 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/160 2024-04-26T23:33:14.068 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/160 2024-04-26T23:33:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/160 2024-04-26T23:33:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/160 2024-04-26T23:33:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/160 2024-04-26T23:33:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 130/160 2024-04-26T23:33:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 131/160 2024-04-26T23:33:14.528 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/160 2024-04-26T23:33:14.587 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/160 2024-04-26T23:33:14.620 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 131/160 2024-04-26T23:33:14.627 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/160 2024-04-26T23:33:14.659 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fuse-2.9.9-15.el9.x86_64 125/160 2024-04-26T23:33:14.803 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 132/160 2024-04-26T23:33:14.833 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/160 2024-04-26T23:33:14.906 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/160 2024-04-26T23:33:14.906 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:14.906 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T23:33:14.906 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:33:14.906 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:33:14.906 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:14.959 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 134/160 2024-04-26T23:33:14.998 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 134/160 2024-04-26T23:33:15.152 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/160 2024-04-26T23:33:15.232 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 136/160 2024-04-26T23:33:15.312 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 126/160 2024-04-26T23:33:15.405 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 126/160 2024-04-26T23:33:15.465 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 127/160 2024-04-26T23:33:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 128/160 2024-04-26T23:33:15.631 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 129/160 2024-04-26T23:33:16.326 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/160 2024-04-26T23:33:16.362 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/160 2024-04-26T23:33:16.462 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/160 2024-04-26T23:33:16.462 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:16.462 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T23:33:16.462 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:33:16.462 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:33:16.462 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:16.513 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 139/160 2024-04-26T23:33:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 139/160 2024-04-26T23:33:16.610 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:16.610 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T23:33:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:16.696 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/160 2024-04-26T23:33:16.805 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/160 2024-04-26T23:33:16.805 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:16.805 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T23:33:16.805 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:33:16.805 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:33:16.805 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:17.006 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 129/160 2024-04-26T23:33:17.058 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 130/160 2024-04-26T23:33:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/160 2024-04-26T23:33:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/160 2024-04-26T23:33:17.282 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:17.282 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T23:33:17.282 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:33:17.282 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:33:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 130/160 2024-04-26T23:33:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 131/160 2024-04-26T23:33:18.405 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 131/160 2024-04-26T23:33:18.588 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 132/160 2024-04-26T23:33:18.627 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/160 2024-04-26T23:33:18.701 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/160 2024-04-26T23:33:18.701 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:18.701 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T23:33:18.702 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:33:18.702 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:33:18.702 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:18.762 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 134/160 2024-04-26T23:33:18.801 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 134/160 2024-04-26T23:33:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/160 2024-04-26T23:33:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 136/160 2024-04-26T23:33:20.101 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/160 2024-04-26T23:33:20.138 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/160 2024-04-26T23:33:20.218 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/160 2024-04-26T23:33:20.218 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:20.218 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T23:33:20.218 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:33:20.218 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:33:20.218 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:20.272 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 139/160 2024-04-26T23:33:20.347 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 139/160 2024-04-26T23:33:20.347 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:20.347 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T23:33:20.347 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:20.440 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/160 2024-04-26T23:33:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/160 2024-04-26T23:33:20.523 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:20.523 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T23:33:20.523 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:33:20.523 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:33:20.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:20.941 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/160 2024-04-26T23:33:21.018 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/160 2024-04-26T23:33:21.018 INFO:teuthology.orchestra.run.smithi032.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:33:21.018 INFO:teuthology.orchestra.run.smithi032.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T23:33:21.018 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:33:21.018 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:33:21.019 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:22.570 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 142/160 2024-04-26T23:33:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 143/160 2024-04-26T23:33:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/160 2024-04-26T23:33:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 145/160 2024-04-26T23:33:22.994 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 146/160 2024-04-26T23:33:23.038 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 147/160 2024-04-26T23:33:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 148/160 2024-04-26T23:33:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/160 2024-04-26T23:33:23.446 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 150/160 2024-04-26T23:33:24.359 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/160 2024-04-26T23:33:24.410 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/160 2024-04-26T23:33:24.470 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/160 2024-04-26T23:33:25.937 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 152/160 2024-04-26T23:33:26.050 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/160 2024-04-26T23:33:26.130 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/160 2024-04-26T23:33:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/160 2024-04-26T23:33:26.339 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 142/160 2024-04-26T23:33:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/160 2024-04-26T23:33:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 157/160 2024-04-26T23:33:26.393 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 143/160 2024-04-26T23:33:26.492 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 157/160 2024-04-26T23:33:26.511 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/160 2024-04-26T23:33:26.540 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 158/160 2024-04-26T23:33:26.540 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 159/160 2024-04-26T23:33:26.562 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 145/160 2024-04-26T23:33:26.679 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 159/160 2024-04-26T23:33:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 146/160 2024-04-26T23:33:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 160/160 2024-04-26T23:33:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 147/160 2024-04-26T23:33:27.128 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 148/160 2024-04-26T23:33:27.137 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 160/160 2024-04-26T23:33:27.137 INFO:teuthology.orchestra.run.smithi016.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T23:33:27.137 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:27.195 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/160 2024-04-26T23:33:27.223 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 150/160 2024-04-26T23:33:28.139 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/160 2024-04-26T23:33:28.191 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/160 2024-04-26T23:33:28.246 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/160 2024-04-26T23:33:29.679 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 152/160 2024-04-26T23:33:29.789 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/160 2024-04-26T23:33:29.876 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/160 2024-04-26T23:33:30.093 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/160 2024-04-26T23:33:30.136 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/160 2024-04-26T23:33:30.136 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 157/160 2024-04-26T23:33:30.246 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 157/160 2024-04-26T23:33:30.302 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 158/160 2024-04-26T23:33:30.302 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 159/160 2024-04-26T23:33:30.468 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 159/160 2024-04-26T23:33:30.612 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 160/160 2024-04-26T23:33:30.926 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 160/160 2024-04-26T23:33:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T23:33:30.926 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:33.027 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/160 2024-04-26T23:33:33.027 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/160 2024-04-26T23:33:33.027 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/160 2024-04-26T23:33:33.027 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/160 2024-04-26T23:33:33.027 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/160 2024-04-26T23:33:33.027 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/160 2024-04-26T23:33:33.027 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/160 2024-04-26T23:33:33.028 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/160 2024-04-26T23:33:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/160 2024-04-26T23:33:33.043 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/160 2024-04-26T23:33:33.043 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/160 2024-04-26T23:33:33.043 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/160 2024-04-26T23:33:33.043 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/160 2024-04-26T23:33:33.043 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/160 2024-04-26T23:33:33.043 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-04-26T23:33:33.044 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/160 2024-04-26T23:33:33.045 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/160 2024-04-26T23:33:33.046 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 77/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 78/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-04-26T23:33:33.047 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 87/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 90/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 93/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 94/160 2024-04-26T23:33:33.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 95/160 2024-04-26T23:33:33.049 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 96/160 2024-04-26T23:33:33.049 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 97/160 2024-04-26T23:33:33.049 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 98/160 2024-04-26T23:33:33.049 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 99/160 2024-04-26T23:33:33.049 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 100/160 2024-04-26T23:33:33.049 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 101/160 2024-04-26T23:33:33.049 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 102/160 2024-04-26T23:33:33.050 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 103/160 2024-04-26T23:33:33.050 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/160 2024-04-26T23:33:33.050 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 105/160 2024-04-26T23:33:33.050 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 106/160 2024-04-26T23:33:33.050 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 107/160 2024-04-26T23:33:33.050 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 108/160 2024-04-26T23:33:33.051 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 109/160 2024-04-26T23:33:33.051 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 110/160 2024-04-26T23:33:33.051 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 111/160 2024-04-26T23:33:33.051 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 112/160 2024-04-26T23:33:33.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 113/160 2024-04-26T23:33:33.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 114/160 2024-04-26T23:33:33.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 115/160 2024-04-26T23:33:33.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 116/160 2024-04-26T23:33:33.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 117/160 2024-04-26T23:33:33.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 118/160 2024-04-26T23:33:33.052 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 119/160 2024-04-26T23:33:33.053 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 120/160 2024-04-26T23:33:33.053 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 121/160 2024-04-26T23:33:33.053 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 122/160 2024-04-26T23:33:33.053 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 123/160 2024-04-26T23:33:33.053 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 124/160 2024-04-26T23:33:33.053 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 125/160 2024-04-26T23:33:33.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 126/160 2024-04-26T23:33:33.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 127/160 2024-04-26T23:33:33.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 128/160 2024-04-26T23:33:33.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 129/160 2024-04-26T23:33:33.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 130/160 2024-04-26T23:33:33.055 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 131/160 2024-04-26T23:33:33.055 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 132/160 2024-04-26T23:33:33.055 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 133/160 2024-04-26T23:33:33.055 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 134/160 2024-04-26T23:33:33.055 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 135/160 2024-04-26T23:33:33.055 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 136/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 137/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 138/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 139/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 140/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 141/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 142/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 143/160 2024-04-26T23:33:33.056 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 144/160 2024-04-26T23:33:33.057 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 145/160 2024-04-26T23:33:33.057 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 146/160 2024-04-26T23:33:33.057 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 147/160 2024-04-26T23:33:33.057 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 148/160 2024-04-26T23:33:33.057 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 149/160 2024-04-26T23:33:33.057 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 150/160 2024-04-26T23:33:33.058 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : re2-1:20211101-3.el9.x86_64 151/160 2024-04-26T23:33:33.058 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 152/160 2024-04-26T23:33:33.058 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 153/160 2024-04-26T23:33:33.058 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 154/160 2024-04-26T23:33:33.058 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 155/160 2024-04-26T23:33:33.059 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-04-26T23:33:33.059 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 157/160 2024-04-26T23:33:33.059 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 158/160 2024-04-26T23:33:33.059 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 159/160 2024-04-26T23:33:35.603 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 160/160 2024-04-26T23:33:35.603 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:35.603 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2024-04-26T23:33:35.603 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.603 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.604 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.605 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T23:33:35.606 INFO:teuthology.orchestra.run.smithi016.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T23:33:35.607 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T23:33:35.608 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T23:33:35.609 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T23:33:35.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T23:33:35.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T23:33:35.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-py-1.10.0-6.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytest-6.2.2-7.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T23:33:35.613 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T23:33:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T23:33:35.615 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T23:33:35.616 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T23:33:35.616 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:35.616 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-26T23:33:36.379 DEBUG:teuthology.parallel:result is None 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/160 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/160 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/160 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/160 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/160 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/160 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/160 2024-04-26T23:33:36.727 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/160 2024-04-26T23:33:36.728 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/160 2024-04-26T23:33:36.729 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/160 2024-04-26T23:33:36.730 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/160 2024-04-26T23:33:36.731 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-04-26T23:33:36.732 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/160 2024-04-26T23:33:36.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-04-26T23:33:36.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-04-26T23:33:36.733 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-04-26T23:33:36.734 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 77/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 78/160 2024-04-26T23:33:36.735 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 87/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 90/160 2024-04-26T23:33:36.736 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 91/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 92/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 93/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 94/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 95/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 96/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 97/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 98/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 99/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 100/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 101/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 102/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 103/160 2024-04-26T23:33:36.737 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 105/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 106/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 107/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 108/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 109/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 110/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 111/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 112/160 2024-04-26T23:33:36.738 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 113/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 114/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 115/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 116/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 117/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 118/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 119/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 120/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 121/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 122/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 123/160 2024-04-26T23:33:36.739 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 124/160 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 125/160 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 126/160 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 127/160 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 128/160 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 129/160 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 130/160 2024-04-26T23:33:36.740 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 131/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 132/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 133/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 134/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 135/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 136/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 137/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 138/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 139/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 140/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 141/160 2024-04-26T23:33:36.741 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 142/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 143/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 144/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 145/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 146/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 147/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 148/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 149/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 150/160 2024-04-26T23:33:36.742 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : re2-1:20211101-3.el9.x86_64 151/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 152/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 153/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 154/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 155/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 157/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 158/160 2024-04-26T23:33:36.743 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 159/160 2024-04-26T23:33:39.191 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 160/160 2024-04-26T23:33:39.191 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.192 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.193 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T23:33:39.194 INFO:teuthology.orchestra.run.smithi032.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T23:33:39.195 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T23:33:39.196 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T23:33:39.197 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T23:33:39.198 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T23:33:39.199 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pluggy-0.13.1-7.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T23:33:39.200 INFO:teuthology.orchestra.run.smithi032.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-py-1.10.0-6.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytest-6.2.2-7.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.201 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T23:33:39.202 INFO:teuthology.orchestra.run.smithi032.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T23:33:39.203 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T23:33:39.204 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T23:33:39.204 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:39.204 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2024-04-26T23:33:39.797 DEBUG:teuthology.parallel:result is None 2024-04-26T23:33:39.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:33:40.032 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T23:33:40.090 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T23:33:40.091 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T23:33:40.091 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T23:33:40.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:33:40.238 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T23:33:40.295 INFO:teuthology.orchestra.run.smithi032.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T23:33:40.295 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T23:33:40.295 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T23:33:40.297 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T23:33:40.297 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:40.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:33:40.370 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:40.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:33:40.440 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T23:33:40.440 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:40.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:33:40.506 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:33:40.611 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:40.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:33:40.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:33:40.825 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T23:33:40.939 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:40.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:33:41.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:33:41.109 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:41.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:33:41.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:33:41.292 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T23:33:41.292 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:41.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:33:41.355 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:33:41.458 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:41.458 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:33:41.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:33:41.630 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T23:33:41.715 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T23:33:41.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-04-26T23:33:41.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-04-26T23:33:41.785 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T23:33:41.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:33:41.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:33:41.853 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T23:33:41.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:33:41.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:33:41.924 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T23:33:41.924 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T23:33:41.924 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T23:33:41.924 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:41.925 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:33:41.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:42.143 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:42.208 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:42.208 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:33:42.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:42.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T23:33:42.509 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T23:33:42.509 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T23:33:42.509 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs_python}', 'email': None, 'first_in_suite': False, 'job_id': '7675311', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'disabled': True}, 'install': {'ceph': {'extra_system_packages': {'deb': ['python3-pytest'], 'rpm': ['python3-pytest']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'disabled': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECypiMhzlZ9MqSitgmx1hZczrjFLHTKAjOedvVnrhbiBbTvQ0/PBniTWwgpgLNxSNTrUZvttS5i/UbVQHF/V8Q=', 'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDH0ZAMpSTmaRpnH7gb2q119fWEHliUitXaDJoRfb1WILdGZZ3plIsS95gWVIbfpcyXMjvkXcrulBhScuAs/9Y0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'python3-pytest'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'python3-pytest']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'workunit': {'clients': {'client.0': ['fs/test_python.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T23:33:42.510 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:33:42.516 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:33:42.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:33:42.601 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:33:42.663 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:42.663 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:33:42.701 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:33:42.701 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-04-26T23:33:42.781 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 23:33:27.633861259 +0000 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 23:29:49.104458238 +0000 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 23:29:49.104458238 +0000 2024-04-26T23:33:42.782 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 23:29:49.104458238 +0000 2024-04-26T23:33:42.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:33:42.882 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T23:33:42.882 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T23:33:42.882 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000269596 s, 1.9 MB/s 2024-04-26T23:33:42.885 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:33:42.923 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-04-26T23:33:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:33:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:43.001 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-04-26T23:33:43.002 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:43.002 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:43.002 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 23:33:27.634861243 +0000 2024-04-26T23:33:43.002 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 23:29:49.706448590 +0000 2024-04-26T23:33:43.002 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 23:29:49.706448590 +0000 2024-04-26T23:33:43.002 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 23:29:49.706448590 +0000 2024-04-26T23:33:43.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:33:43.105 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T23:33:43.106 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T23:33:43.106 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000249455 s, 2.1 MB/s 2024-04-26T23:33:43.110 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:33:43.156 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 23:33:27.635861227 +0000 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 23:29:50.293439182 +0000 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 23:29:50.293439182 +0000 2024-04-26T23:33:43.198 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 23:29:50.293439182 +0000 2024-04-26T23:33:43.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:33:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T23:33:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T23:33:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000194649 s, 2.6 MB/s 2024-04-26T23:33:43.308 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:33:43.352 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-04-26T23:33:43.438 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 23:33:27.635861227 +0000 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 23:29:50.912429262 +0000 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 23:29:50.912429262 +0000 2024-04-26T23:33:43.439 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 23:29:50.912429262 +0000 2024-04-26T23:33:43.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:33:43.548 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T23:33:43.548 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T23:33:43.548 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000193643 s, 2.6 MB/s 2024-04-26T23:33:43.552 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:33:43.592 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:33:43.593 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:43.593 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:33:43.636 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:33:43.637 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-04-26T23:33:43.720 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-04-26 23:33:31.420046469 +0000 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-04-26 23:30:36.165805334 +0000 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-04-26 23:30:36.165805334 +0000 2024-04-26T23:33:43.721 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-04-26 23:30:36.165805334 +0000 2024-04-26T23:33:43.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:33:43.822 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-04-26T23:33:43.823 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-04-26T23:33:43.823 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000236168 s, 2.2 MB/s 2024-04-26T23:33:43.825 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:33:43.866 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-04-26T23:33:43.945 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:33:43.945 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:43.945 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-26T23:33:43.945 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:43.945 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:43.945 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-04-26 23:33:31.420046469 +0000 2024-04-26T23:33:43.946 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-04-26 23:30:36.770793092 +0000 2024-04-26T23:33:43.946 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-04-26 23:30:36.770793092 +0000 2024-04-26T23:33:43.946 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-04-26 23:30:36.770793092 +0000 2024-04-26T23:33:43.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:33:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-04-26T23:33:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-04-26T23:33:44.041 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000206286 s, 2.5 MB/s 2024-04-26T23:33:44.044 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:33:44.084 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-04-26T23:33:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:33:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:44.165 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-26T23:33:44.165 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:44.165 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:44.165 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-04-26 23:33:31.421046449 +0000 2024-04-26T23:33:44.165 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-04-26 23:30:37.359781174 +0000 2024-04-26T23:33:44.165 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-04-26 23:30:37.359781174 +0000 2024-04-26T23:33:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-04-26 23:30:37.359781174 +0000 2024-04-26T23:33:44.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:33:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-04-26T23:33:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-04-26T23:33:44.263 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000179585 s, 2.9 MB/s 2024-04-26T23:33:44.266 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:33:44.308 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-04-26T23:33:44.395 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-04-26 23:33:31.422046428 +0000 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-04-26 23:30:37.960769013 +0000 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-04-26 23:30:37.960769013 +0000 2024-04-26T23:33:44.396 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2024-04-26 23:30:37.960769013 +0000 2024-04-26T23:33:44.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:33:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-04-26T23:33:44.510 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-04-26T23:33:44.511 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000256952 s, 2.0 MB/s 2024-04-26T23:33:44.513 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:33:44.562 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:33:44.562 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:33:44.562 INFO:tasks.ceph:Generating config... 2024-04-26T23:33:44.563 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T23:33:44.563 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T23:33:44.564 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T23:33:44.564 INFO:tasks.ceph:[client] pid file = 2024-04-26T23:33:44.564 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T23:33:44.564 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T23:33:44.564 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T23:33:44.565 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T23:33:44.565 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T23:33:44.565 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T23:33:44.565 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T23:33:44.565 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T23:33:44.565 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T23:33:44.565 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T23:33:44.565 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T23:33:44.566 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T23:33:44.566 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T23:33:44.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T23:33:44.724 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T23:33:44.734 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T23:33:44.849 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:33:44.928 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.32'), ('mon.c', '[v2:172.21.15.32:3301,v1:172.21.15.32:6790]')] 2024-04-26T23:33:44.928 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T23:33:44.929 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:44.929 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:33:44.980 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.32 --addv c '[v2:172.21.15.32:3301,v1:172.21.15.32:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:fsid c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-04-26T23:33:45.134096+0000 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-26T23:33:45.134096+0000 2024-04-26T23:33:45.136 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-04-26T23:33:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-04-26T23:33:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-04-26T23:33:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.b 2024-04-26T23:33:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] mon.c 2024-04-26T23:33:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T23:33:45.139 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:33:45.190 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a... 2024-04-26T23:33:45.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:33:45.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:33:45.316 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-04-26T23:33:45.316 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-04-26T23:33:45.317 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:33:45.317 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-04-26T23:33:45.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.317 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-04-26T23:33:45.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.318 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-04-26T23:33:45.318 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.318 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-04-26T23:33:45.318 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-04-26T23:33:45.318 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.318 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-04-26T23:33:45.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:33:45.320 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.321 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-04-26T23:33:45.322 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-04-26T23:33:45.322 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-04-26T23:33:45.322 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.16,172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790]" 2024-04-26T23:33:45.322 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a 2024-04-26T23:33:45.322 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.322 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-04-26T23:33:45.322 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-04-26T23:33:45.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.323 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-04-26T23:33:45.323 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-04-26T23:33:45.323 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:33:45.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.323 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-04-26T23:33:45.324 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-04-26T23:33:45.324 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.324 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-04-26T23:33:45.324 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-04-26T23:33:45.324 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-04-26T23:33:45.324 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-04-26T23:33:45.324 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.325 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-04-26T23:33:45.325 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-04-26T23:33:45.325 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.325 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:33:45.325 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.325 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-04-26T23:33:45.325 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.326 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-04-26T23:33:45.326 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.326 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:33:45.326 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-04-26T23:33:45.326 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.326 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-04-26T23:33:45.326 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-04-26T23:33:45.327 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2024-04-26T23:33:45.328 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:33:45.329 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: mon down mkfs grace = 300 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-04-26T23:33:45.330 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = "" 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-04-26T23:33:45.331 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2024-04-26T23:33:45.332 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-26T23:33:45.334 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:33:45.335 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790]" 2024-04-26T23:33:45.336 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a 2024-04-26T23:33:45.337 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.337 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-26T23:33:45.337 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-26T23:33:45.337 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.337 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-26T23:33:45.337 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-26T23:33:45.337 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:33:45.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2024-04-26T23:33:45.339 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T23:33:45.340 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:33:45.341 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: mon down mkfs grace = 300 2024-04-26T23:33:45.342 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = "" 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-26T23:33:45.343 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-26T23:33:45.344 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-26T23:33:45.345 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-26T23:33:45.355 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T23:33:45.355 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T23:33:45.496 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T23:33:45.497 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:45.497 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T23:33:45.552 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:45.552 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T23:33:45.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T23:33:45.603 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:45.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:33:45.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:33:45.724 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:33:45.724 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:45.813 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-04-26T23:33:45.813 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:45.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:33:45.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:33:45.914 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:33:45.914 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:45.995 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T23:33:45.995 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T23:33:45.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:33:46.209 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:33:46.220 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:33:46.354 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:33:46.362 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T23:33:46.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:33:46.525 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:33:46.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T23:33:46.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:33:46.749 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:33:46.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T23:33:46.821 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T23:33:46.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T23:33:46.949 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T23:33:47.004 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T23:33:47.005 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:33:47.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T23:33:47.096 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:33:47.097 INFO:tasks.ceph:role: osd.0 2024-04-26T23:33:47.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T23:33:47.097 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:33:47.187 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:33:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:33:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:33:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:33:47.187 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:33:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:33:47.188 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:33:47.188 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:33:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:33:47.188 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:33:47.221 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T23:33:47.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T23:33:47.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T23:33:47.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T23:33:47.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T23:33:47.483 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:33:47.484 INFO:tasks.ceph:role: osd.1 2024-04-26T23:33:47.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T23:33:47.484 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:33:47.564 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:33:47.565 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:33:47.599 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T23:33:47.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T23:33:47.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T23:33:47.709 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T23:33:47.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T23:33:47.865 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:33:47.865 INFO:tasks.ceph:role: osd.2 2024-04-26T23:33:47.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T23:33:47.865 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:33:47.948 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:33:47.949 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:33:47.991 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T23:33:47.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T23:33:47.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T23:33:48.101 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T23:33:48.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T23:33:48.274 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:33:48.274 INFO:tasks.ceph:role: osd.3 2024-04-26T23:33:48.275 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T23:33:48.275 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:33:48.362 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:33:48.363 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:33:48.363 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:33:48.399 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T23:33:48.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T23:33:48.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T23:33:48.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T23:33:48.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:48.696+0000 7fb53b20d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T23:33:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:48.697+0000 7fb53b20d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T23:33:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:48.697+0000 7fb53b20d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:33:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:48.697+0000 7fb53b20d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:33:48.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:48.697+0000 7fb53b20d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:33:48.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:48.700+0000 7fb53b20d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T23:33:51.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T23:33:51.984 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:52.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:52.116+0000 7fb584c1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T23:33:52.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:52.116+0000 7fb584c1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T23:33:52.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:52.116+0000 7fb584c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:33:52.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:52.116+0000 7fb584c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:33:52.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:52.116+0000 7fb584c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:33:52.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:52.119+0000 7fb584c1b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T23:33:55.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T23:33:55.182 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:55.314+0000 7fbaf5944640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T23:33:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:55.314+0000 7fbaf5944640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T23:33:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:55.314+0000 7fbaf5944640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:33:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:55.314+0000 7fbaf5944640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:33:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:55.314+0000 7fbaf5944640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:33:55.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:55.317+0000 7fbaf5944640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T23:33:58.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T23:33:58.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:33:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:58.497+0000 7f70e4814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T23:33:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:58.498+0000 7f70e4814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T23:33:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:58.498+0000 7f70e4814640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:33:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:58.498+0000 7f70e4814640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:33:58.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:58.498+0000 7f70e4814640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:33:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:33:58.500+0000 7f70e4814640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T23:34:01.709 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T23:34:01.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T23:34:01.886 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:34:01.886 INFO:tasks.ceph:role: osd.4 2024-04-26T23:34:01.886 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-26T23:34:01.886 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:34:01.961 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:34:01.998 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-04-26T23:34:02.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-04-26T23:34:02.004 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T23:34:02.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T23:34:02.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T23:34:02.240 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:34:02.241 INFO:tasks.ceph:role: osd.5 2024-04-26T23:34:02.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-26T23:34:02.241 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:34:02.315 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:34:02.316 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:34:02.351 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-04-26T23:34:02.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-04-26T23:34:02.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T23:34:02.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T23:34:02.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T23:34:02.602 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:34:02.602 INFO:tasks.ceph:role: osd.6 2024-04-26T23:34:02.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-26T23:34:02.603 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:34:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:34:02.673 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:34:02.673 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:34:02.708 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-04-26T23:34:02.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-04-26T23:34:02.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T23:34:02.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T23:34:02.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T23:34:02.935 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:34:02.935 INFO:tasks.ceph:role: osd.7 2024-04-26T23:34:02.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-26T23:34:02.935 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:34:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:34:03.004 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:34:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-04-26T23:34:03.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-04-26T23:34:03.044 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T23:34:03.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T23:34:03.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:34:03.327 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:03.324+0000 7f675fd50640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T23:34:03.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:03.324+0000 7f675fd50640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T23:34:03.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:03.324+0000 7f675fd50640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:34:03.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:03.325+0000 7f675fd50640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:34:03.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:03.325+0000 7f675fd50640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:34:03.331 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:03.328+0000 7f675fd50640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T23:34:06.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T23:34:06.662 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:34:06.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:06.797+0000 7f75d7418640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T23:34:06.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:06.798+0000 7f75d7418640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T23:34:06.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:06.798+0000 7f75d7418640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:34:06.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:06.798+0000 7f75d7418640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:34:06.802 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:06.798+0000 7f75d7418640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:34:06.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:06.801+0000 7f75d7418640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T23:34:10.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T23:34:10.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:34:10.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:10.240+0000 7f4e4f219640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T23:34:10.243 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:10.241+0000 7f4e4f219640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T23:34:10.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:10.241+0000 7f4e4f219640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:34:10.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:10.241+0000 7f4e4f219640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:34:10.244 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:10.241+0000 7f4e4f219640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:34:10.245 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:10.243+0000 7f4e4f219640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T23:34:12.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:34:12.519 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:34:13.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T23:34:13.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:34:13.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:13.429+0000 7fbd4aa1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T23:34:13.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:13.429+0000 7fbd4aa1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T23:34:13.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:13.429+0000 7fbd4aa1c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:34:13.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:13.429+0000 7fbd4aa1c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:34:13.432 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:13.429+0000 7fbd4aa1c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:34:13.434 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:13.432+0000 7fbd4aa1c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T23:34:16.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T23:34:16.822 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T23:34:16.822 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:16.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T23:34:16.912 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:16.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T23:34:16.997 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:16.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T23:34:17.087 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:17.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T23:34:17.186 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:17.186 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T23:34:17.279 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:17.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T23:34:17.368 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:17.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T23:34:17.462 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:17.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T23:34:17.551 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:17.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T23:34:17.640 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:17.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T23:34:17.733 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:17.733 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T23:34:17.822 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:17.822 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T23:34:17.910 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:17.910 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T23:34:17.970 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T23:34:17.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:34:17.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:34:18.057 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-04-26T23:34:18.057 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDaOSxmIClaDBAABXzJ6pLkJzHQ+3RrXuJRrw== 2024-04-26T23:34:18.057 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDaOSxmfpYwHxAAUVD64s4ayFCSdXnP80dksA== 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDcOSxmjc+XKRAAGfJvdTc5TQU26AAee+qI2w== 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDgOSxmGEH+BhAA1iEQKql8JkFm/lsXQD4UMg== 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDjOSxmF3rLEhAA+jHADwe4rmRqRb/m95Fl6g== 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDmOSxmAcu8HRAAlwax4i8/Tlugy07fJ8MtyQ== 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDaOSxm/S4DFRAAKwhgBnsvUfhm1s7j3LQAFg== 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-26T23:34:18.058 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDaOSxmU+GXLBAApFiTYe8wsqNbG1EGEpspVA== 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDrOSxmrwtoExAAh1TuNTW00smbqQeWMQsQdA== 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDuOSxmauqjLxAAbMNhvaCgjqxzkg8Sb5RMtw== 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDyOSxm61hgDhAAGVqmq2rgCzMNf2MbGsmygg== 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD1OSxmy/GaGRAAWCTQ1fuR5GL54HKUt13BJg== 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-26T23:34:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDaOSxmFt5/OBAA/2xDTZcl4TCHF1qkiY3bhQ== 2024-04-26T23:34:18.060 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-04-26T23:34:18.060 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDaOSxmIClaDBAABXzJ6pLkJzHQ+3RrXuJRrw== 2024-04-26T23:34:18.060 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2024-04-26T23:34:18.060 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDaOSxmfpYwHxAAUVD64s4ayFCSdXnP80dksA== 2024-04-26T23:34:18.060 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-04-26T23:34:18.060 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDcOSxmjc+XKRAAGfJvdTc5TQU26AAee+qI2w== 2024-04-26T23:34:18.060 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDgOSxmGEH+BhAA1iEQKql8JkFm/lsXQD4UMg== 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDjOSxmF3rLEhAA+jHADwe4rmRqRb/m95Fl6g== 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDmOSxmAcu8HRAAlwax4i8/Tlugy07fJ8MtyQ== 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDaOSxm/S4DFRAAKwhgBnsvUfhm1s7j3LQAFg== 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDaOSxmU+GXLBAApFiTYe8wsqNbG1EGEpspVA== 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDrOSxmrwtoExAAh1TuNTW00smbqQeWMQsQdA== 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDuOSxmauqjLxAAbMNhvaCgjqxzkg8Sb5RMtw== 2024-04-26T23:34:18.061 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-04-26T23:34:18.062 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDyOSxm61hgDhAAGVqmq2rgCzMNf2MbGsmygg== 2024-04-26T23:34:18.062 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-04-26T23:34:18.062 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQD1OSxmy/GaGRAAWCTQ1fuR5GL54HKUt13BJg== 2024-04-26T23:34:18.062 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-04-26T23:34:18.062 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDaOSxmFt5/OBAA/2xDTZcl4TCHF1qkiY3bhQ== 2024-04-26T23:34:18.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:34:18.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:34:18.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:34:18.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:34:18.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:18.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:34:18.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:34:19.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:34:19.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:34:19.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.284 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.432 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.723 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.730 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:34:19.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:34:19.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:34:20.020 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T23:34:20.020 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T23:34:20.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:34:20.264 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T23:34:20.343 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T23:34:20.439 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:34:20.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T23:34:20.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T23:34:20.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:34:20.903 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T23:34:20.983 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:34:20.994 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:34:21.048 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T23:34:21.048 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:34:21.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:34:21.056 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:34:21.056 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:34:21.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:34:21.063 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:34:21.063 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:34:21.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:34:21.070 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:34:21.070 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T23:34:21.070 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T23:34:21.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T23:34:21.077 INFO:tasks.ceph.mgr.y:Started 2024-04-26T23:34:21.077 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T23:34:21.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T23:34:21.082 INFO:tasks.ceph.mgr.x:Started 2024-04-26T23:34:21.083 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T23:34:21.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T23:34:21.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.252+0000 7f1ff3000640 1 Processor -- start 2024-04-26T23:34:21.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.253+0000 7f1ff3000640 1 -- start start 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff3000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff3000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff3000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec142ce0 con 0x7f1fec142900 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff3000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec0ba480 con 0x7f1fec0b6400 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff3000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0b81a0 con 0x7f1fec0b6880 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff1000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1feb400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff1000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:41318/0 (socket says 172.21.15.16:41318) 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 learned_addr learned my addr 172.21.15.16:0/501465582 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:21.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1febe00640 1 --1- 172.21.15.16:0/501465582 >> v1:172.21.15.16:6789/0 conn(0x7f1fec142900 0x7f1fec148550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44748/0 (socket says 172.21.15.16:44748) 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.254+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.255+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:34:21.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.255+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:34:21.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.456+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:21.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.456+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:21.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:21.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:21.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:21.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:34:21.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:21.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:21.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:34:21.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.457+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:34:21.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.857+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:21.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.857+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:21.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:21.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:21.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:21.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:34:21.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:21.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:21.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:34:21.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:21.858+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.659+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:22.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:22.660+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:34:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 msgr2=0x7f1fec153330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:34:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fec0b6880 0x7f1fec153330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 msgr2=0x7f1fec150de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:34:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.16:3300/0 conn(0x7f1fec0b6400 0x7f1fec150de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 -- 172.21.15.16:0/501465582 >> v1:172.21.15.16:6789/0 conn(0x7f1fec142900 legacy=0x7f1fec148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:24.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 -- 172.21.15.16:0/501465582 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec148c60 con 0x7f1fcc0036c0 2024-04-26T23:34:24.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.253+0000 7f1fe9600640 1 -- 172.21.15.16:0/501465582 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec0ba480 con 0x7f1fcc0073f0 2024-04-26T23:34:24.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.254+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:24.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.255+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:24.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.255+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.255+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:24.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.255+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:34:24.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.456+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:24.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.457+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:24.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.457+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:24.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.457+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:24.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.457+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:34:24.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.858+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:24.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.859+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:24.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.859+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:24.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.859+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:24.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:24.859+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:34:25.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:25.661+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:25.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:25.661+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:34:25.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:25.661+0000 7f1feb400640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:34:25.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:25.661+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:34:25.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:25.661+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:34:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.517+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615636943 0 0) 0x7f1fec148c60 con 0x7f1fcc0036c0 2024-04-26T23:34:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.517+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd0003520 con 0x7f1fcc0036c0 2024-04-26T23:34:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.518+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 <== mon.1 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3547257775 0 0) 0x7f1fd0003520 con 0x7f1fcc0036c0 2024-04-26T23:34:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.518+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 msgr2=0x7f1fcc009890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:34:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.518+0000 7f1feaa00640 1 --2- 172.21.15.16:0/501465582 >> v2:172.21.15.32:3300/0 conn(0x7f1fcc0073f0 0x7f1fcc009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.518+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc00b000 con 0x7f1fcc0036c0 2024-04-26T23:34:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.518+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 <== mon.1 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f1fdc0016f0 con 0x7f1fcc0036c0 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.518+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 >> v1:172.21.15.32:6789/0 conn(0x7f1fcc0036c0 legacy=0x7f1fcc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.519+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 reap_dead start 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.519+0000 7f1feaa00640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0003a00 0x7f1fd0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.519+0000 7f1feaa00640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd0004800 0x7f1fd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.519+0000 7f1feaa00640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00053c0 0x7f1fd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.519+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0ba480 con 0x7f1fd0003a00 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.519+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd000c280 con 0x7f1fd00053c0 2024-04-26T23:34:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.519+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd000c480 con 0x7f1fd0004800 2024-04-26T23:34:26.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.520+0000 7f1feb400640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd0004800 0x7f1fd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:26.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.520+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00053c0 0x7f1fd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:26.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.520+0000 7f1febe00640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0003a00 0x7f1fd0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:26.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.520+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd0004800 msgr2=0x7f1fd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.521+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd0004800 0x7f1fd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.521+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0003a00 msgr2=0x7f1fd0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.521+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0003a00 0x7f1fd0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.521+0000 7f1ff1000640 1 -- 172.21.15.16:0/501465582 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd0003520 con 0x7f1fd00053c0 2024-04-26T23:34:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.522+0000 7f1ff1000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00053c0 0x7f1fd000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0b7730 tx=0x7f1fd0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abde3e41e81c8290 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.525+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4034070 con 0x7f1fd00053c0 2024-04-26T23:34:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.525+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe402c480 con 0x7f1fd00053c0 2024-04-26T23:34:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.525+0000 7f1feaa00640 1 -- 172.21.15.16:0/501465582 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40096d0 con 0x7f1fd00053c0 2024-04-26T23:34:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 -- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00053c0 msgr2=0x7f1fd000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00053c0 0x7f1fd000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0b7730 tx=0x7f1fd0005830 comp rx=0 tx=0).stop 2024-04-26T23:34:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 -- 172.21.15.16:0/501465582 shutdown_connections 2024-04-26T23:34:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd00053c0 0x7f1fd000b9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd0004800 0x7f1fd0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 --2- 172.21.15.16:0/501465582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0003a00 0x7f1fd0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 -- 172.21.15.16:0/501465582 >> 172.21.15.16:0/501465582 conn(0x7f1fec068270 msgr2=0x7f1fec068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 -- 172.21.15.16:0/501465582 shutdown_connections 2024-04-26T23:34:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.526+0000 7f1ff3000640 1 -- 172.21.15.16:0/501465582 wait complete. 2024-04-26T23:34:26.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.530+0000 7f1ff3000640 1 Processor -- start 2024-04-26T23:34:26.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.531+0000 7f1ff3000640 1 -- start start 2024-04-26T23:34:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.531+0000 7f1ff3000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd0003a00 0x7f1fec144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.531+0000 7f1ff3000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0004800 0x7f1fec145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.531+0000 7f1ff3000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd00053c0 0x7f1fec0bc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1ff3000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0ba130 con 0x7f1fd0004800 2024-04-26T23:34:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1ff3000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0babc0 con 0x7f1fd0003a00 2024-04-26T23:34:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1ff3000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0b60b0 con 0x7f1fd00053c0 2024-04-26T23:34:26.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1feb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0004800 0x7f1fec145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:26.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1feb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0004800 0x7f1fec145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36514/0 (socket says 172.21.15.16:36514) 2024-04-26T23:34:26.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1feb400640 1 -- 172.21.15.16:0/4034699254 learned_addr learned my addr 172.21.15.16:0/4034699254 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:26.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1ff1000640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd00053c0 0x7f1fec0bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:26.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.532+0000 7f1febe00640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd0003a00 0x7f1fec144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:26.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.533+0000 7f1feb400640 1 -- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd00053c0 msgr2=0x7f1fec0bc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:26.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.533+0000 7f1feb400640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd00053c0 0x7f1fec0bc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.533+0000 7f1feb400640 1 -- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd0003a00 msgr2=0x7f1fec144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:26.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.533+0000 7f1feb400640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd0003a00 0x7f1fec144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.533+0000 7f1feb400640 1 -- 172.21.15.16:0/4034699254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0bdcf0 con 0x7f1fd0004800 2024-04-26T23:34:26.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.533+0000 7f1feb400640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0004800 0x7f1fec145750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80038f0 tx=0x7f1fd8003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:26.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.534+0000 7f1fe3e00640 1 -- 172.21.15.16:0/4034699254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8017a20 con 0x7f1fd0004800 2024-04-26T23:34:26.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.534+0000 7f1fe3e00640 1 -- 172.21.15.16:0/4034699254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd8028070 con 0x7f1fd0004800 2024-04-26T23:34:26.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.534+0000 7f1fe3e00640 1 -- 172.21.15.16:0/4034699254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8017e00 con 0x7f1fd0004800 2024-04-26T23:34:26.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.534+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec0b42b0 con 0x7f1fd0004800 2024-04-26T23:34:26.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.534+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec1447b0 con 0x7f1fd0004800 2024-04-26T23:34:26.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.535+0000 7f1fe3e00640 1 -- 172.21.15.16:0/4034699254 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1fd8022070 con 0x7f1fd0004800 2024-04-26T23:34:26.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.535+0000 7f1fe3e00640 1 -- 172.21.15.16:0/4034699254 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1fd80235b0 con 0x7f1fd0004800 2024-04-26T23:34:26.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.536+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec076670 con 0x7f1fd0004800 2024-04-26T23:34:26.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.539+0000 7f1fe3e00640 1 -- 172.21.15.16:0/4034699254 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1fd8033060 con 0x7f1fd0004800 2024-04-26T23:34:26.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.614+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1fec069840 con 0x7f1fd0004800 2024-04-26T23:34:26.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.618+0000 7f1fe3e00640 1 -- 172.21.15.16:0/4034699254 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1fd8020040 con 0x7f1fd0004800 2024-04-26T23:34:26.622 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-04-26T23:34:26.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0004800 msgr2=0x7f1fec145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0004800 0x7f1fec145750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80038f0 tx=0x7f1fd8003cf0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 shutdown_connections 2024-04-26T23:34:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1fd00053c0 0x7f1fec0bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd0004800 0x7f1fec145750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 --2- 172.21.15.16:0/4034699254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1fd0003a00 0x7f1fec144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:26.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 >> 172.21.15.16:0/4034699254 conn(0x7f1fec068270 msgr2=0x7f1fec141f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:26.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 shutdown_connections 2024-04-26T23:34:26.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:26.620+0000 7f1ff3000640 1 -- 172.21.15.16:0/4034699254 wait complete. 2024-04-26T23:34:26.643 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T23:34:26.643 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T23:34:26.643 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:26.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T23:34:26.730 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:26.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T23:34:26.731 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:26.727+0000 7f61c8b20040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:34:26.817 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:26.817 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T23:34:26.905 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:34:26.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T23:34:26.923 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:26.919+0000 7f61c8b20040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:34:26.992 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:26.988+0000 7f61c8b20040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:34:26.997 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:26.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T23:34:27.087 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:27.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T23:34:27.159 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:27.160 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T23:34:27.288 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-04-26T23:34:27.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T23:34:27.295 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:27.291+0000 7f61c8b20040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:34:27.352 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:27.349+0000 7f61c8b20040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:34:27.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new bf877757-9a6e-4afe-ac7e-74d7e0c75ced 0 2024-04-26T23:34:27.391 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:27.387+0000 7f285ec1e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:34:27.590 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:27.586+0000 7f285ec1e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:34:27.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.597+0000 7f9b9d200640 1 Processor -- start 2024-04-26T23:34:27.600 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.597+0000 7f9b9d200640 1 -- start start 2024-04-26T23:34:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.598+0000 7f9b9d200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b980bae80 0x7f9b980b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.598+0000 7f9b9d200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b9806d220 0x7f9b981422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.598+0000 7f9b9d200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b980b9ec0 con 0x7f9b98073b90 2024-04-26T23:34:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.598+0000 7f9b9d200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f9b9806e380 con 0x7f9b9806d220 2024-04-26T23:34:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.598+0000 7f9b9d200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f9b980ba480 con 0x7f9b980bae80 2024-04-26T23:34:27.602 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b980bae80 0x7f9b980b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9b9806d220 0x7f9b981422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b980bae80 0x7f9b980b97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:46912/0 (socket says 172.21.15.32:46912) 2024-04-26T23:34:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97400640 1 -- 172.21.15.32:0/1671579213 learned_addr learned my addr 172.21.15.32:0/1671579213 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97400640 1 -- 172.21.15.32:0/1671579213 >> v2:172.21.15.32:3300/0 conn(0x7f9b9806d220 msgr2=0x7f9b981422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97400640 1 --2- 172.21.15.32:0/1671579213 >> v2:172.21.15.32:3300/0 conn(0x7f9b9806d220 0x7f9b981422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.603 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97400640 1 -- 172.21.15.32:0/1671579213 >> v1:172.21.15.32:6789/0 conn(0x7f9b98073b90 legacy=0x7f9b980bbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97400640 1 -- 172.21.15.32:0/1671579213 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b980ba1a0 con 0x7f9b980bae80 2024-04-26T23:34:27.604 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.599+0000 7f9b97e00640 1 --2- 172.21.15.32:0/1671579213 >> v2:172.21.15.32:3300/0 conn(0x7f9b9806d220 0x7f9b981422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:27.605 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.600+0000 7f9b97400640 1 --2- 172.21.15.32:0/1671579213 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b980bae80 0x7f9b980b97d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009870 tx=0x7f9b8802a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf0cbadcbd5489c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b96000640 1 -- 172.21.15.32:0/1671579213 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88037070 con 0x7f9b980bae80 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b96000640 1 -- 172.21.15.32:0/1671579213 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b88032440 con 0x7f9b980bae80 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b96000640 1 -- 172.21.15.32:0/1671579213 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88032810 con 0x7f9b980bae80 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b9d200640 1 -- 172.21.15.32:0/1671579213 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b980bae80 msgr2=0x7f9b980b97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b9d200640 1 --2- 172.21.15.32:0/1671579213 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b980bae80 0x7f9b980b97d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009870 tx=0x7f9b8802a1d0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b9d200640 1 -- 172.21.15.32:0/1671579213 shutdown_connections 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b9d200640 1 --2- 172.21.15.32:0/1671579213 >> v2:172.21.15.32:3300/0 conn(0x7f9b9806d220 0x7f9b981422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b9d200640 1 --2- 172.21.15.32:0/1671579213 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b980bae80 0x7f9b980b97d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b9d200640 1 -- 172.21.15.32:0/1671579213 >> 172.21.15.32:0/1671579213 conn(0x7f9b98068090 msgr2=0x7f9b980684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.601+0000 7f9b9d200640 1 -- 172.21.15.32:0/1671579213 shutdown_connections 2024-04-26T23:34:27.606 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.602+0000 7f9b9d200640 1 -- 172.21.15.32:0/1671579213 wait complete. 2024-04-26T23:34:27.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.604+0000 7f9b9d200640 1 Processor -- start 2024-04-26T23:34:27.607 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.604+0000 7f9b9d200640 1 -- start start 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b9d200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b9806d220 0x7f9b981d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b9d200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b98073b90 0x7f9b981d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b9d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b980bae80 0x7f9b981e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b9d200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98142980 con 0x7f9b980bae80 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b9d200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98142800 con 0x7f9b9806d220 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b9d200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f9b98142b00 con 0x7f9b98073b90 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b97400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b9806d220 0x7f9b981d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b97400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b9806d220 0x7f9b981d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56654/0 (socket says 172.21.15.32:56654) 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b97400640 1 -- 172.21.15.32:0/1518309481 learned_addr learned my addr 172.21.15.32:0/1518309481 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b96a00640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b98073b90 0x7f9b981d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b97400640 1 -- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b98073b90 msgr2=0x7f9b981d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.609 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b97400640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b98073b90 0x7f9b981d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b97400640 1 -- 172.21.15.32:0/1518309481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b980bae80 msgr2=0x7f9b981e0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.605+0000 7f9b97400640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b980bae80 0x7f9b981e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.610 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.606+0000 7f9b97400640 1 -- 172.21.15.32:0/1518309481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b98149690 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.606+0000 7f9b97400640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b9806d220 0x7f9b981d1b50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009870 tx=0x7f9b880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.606+0000 7f9b8f400640 1 -- 172.21.15.32:0/1518309481 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88041070 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.606+0000 7f9b8f400640 1 -- 172.21.15.32:0/1518309481 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8803c890 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.606+0000 7f9b8f400640 1 -- 172.21.15.32:0/1518309481 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88037040 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.606+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b981d42c0 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.606+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b98145650 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.607+0000 7f9b8f400640 1 -- 172.21.15.32:0/1518309481 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9b88044070 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.607+0000 7f9b8f400640 1 -- 172.21.15.32:0/1518309481 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f9b88046ce0 con 0x7f9b9806d220 2024-04-26T23:34:27.611 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.607+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b98076600 con 0x7f9b9806d220 2024-04-26T23:34:27.614 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.610+0000 7f9b8f400640 1 -- 172.21.15.32:0/1518309481 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9b88046450 con 0x7f9b9806d220 2024-04-26T23:34:27.657 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:27.654+0000 7f285ec1e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:34:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.689+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf877757-9a6e-4afe-ac7e-74d7e0c75ced", "id": 0} v 0) -- 0x7f9b9806eb50 con 0x7f9b9806d220 2024-04-26T23:34:27.702 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.699+0000 7f9b8f400640 1 -- 172.21.15.32:0/1518309481 <== mon.1 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf877757-9a6e-4afe-ac7e-74d7e0c75ced", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f9b8803cc80 con 0x7f9b9806d220 2024-04-26T23:34:27.702 INFO:teuthology.orchestra.run.smithi032.stdout:0 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b9806d220 msgr2=0x7f9b981d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b9806d220 0x7f9b981d1b50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b88009870 tx=0x7f9b880046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 shutdown_connections 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b980bae80 0x7f9b981e0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9b98073b90 0x7f9b981d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 --2- 172.21.15.32:0/1518309481 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9b9806d220 0x7f9b981d1b50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 >> 172.21.15.32:0/1518309481 conn(0x7f9b98068090 msgr2=0x7f9b98141260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 shutdown_connections 2024-04-26T23:34:27.704 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.700+0000 7f9b9d200640 1 -- 172.21.15.32:0/1518309481 wait complete. 2024-04-26T23:34:27.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new a7169ab0-32fc-4276-9979-76aee7521000 1 2024-04-26T23:34:27.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.904+0000 7f6a70a00640 1 Processor -- start 2024-04-26T23:34:27.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.905+0000 7f6a70a00640 1 -- start start 2024-04-26T23:34:27.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.905+0000 7f6a70a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b6940 0x7f6a6c1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a70a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a6c0b5640 0x7f6a6c149e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a70a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6a6c13ff40 0x7f6a6c1403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a70a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6c0b3af0 con 0x7f6a6c13ff40 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a70a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6c070680 con 0x7f6a6c0b5640 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a70a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0718e0 con 0x7f6a6c0b6940 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a69e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a6c0b5640 0x7f6a6c149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b6940 0x7f6a6c1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b6940 0x7f6a6c1498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39018/0 (socket says 172.21.15.32:39018) 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 -- 172.21.15.32:0/3974518151 learned_addr learned my addr 172.21.15.32:0/3974518151 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a69e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6a6c0b5640 0x7f6a6c149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40672/0 (socket says 172.21.15.32:40672) 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6b200640 1 --2- 172.21.15.32:0/3974518151 >> v2:172.21.15.16:3300/0 conn(0x7f6a6c13ff40 0x7f6a6c1403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.910 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 -- 172.21.15.32:0/3974518151 >> v2:172.21.15.32:3300/0 conn(0x7f6a6c0b5640 msgr2=0x7f6a6c149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:27.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 --2- 172.21.15.32:0/3974518151 >> v2:172.21.15.32:3300/0 conn(0x7f6a6c0b5640 0x7f6a6c149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 -- 172.21.15.32:0/3974518151 >> v2:172.21.15.16:3300/0 conn(0x7f6a6c13ff40 msgr2=0x7f6a6c1403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:27.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 --2- 172.21.15.32:0/3974518151 >> v2:172.21.15.16:3300/0 conn(0x7f6a6c13ff40 0x7f6a6c1403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a6a800640 1 -- 172.21.15.32:0/3974518151 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0b6d20 con 0x7f6a6c0b6940 2024-04-26T23:34:27.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.906+0000 7f6a69e00640 1 --2- 172.21.15.32:0/3974518151 >> v2:172.21.15.32:3300/0 conn(0x7f6a6c0b5640 0x7f6a6c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:27.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.907+0000 7f6a6a800640 1 --2- 172.21.15.32:0/3974518151 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b6940 0x7f6a6c1498e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0b7550 tx=0x7f6a5c02a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d67a7f2b2e7f7191 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:27.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a69400640 1 -- 172.21.15.32:0/3974518151 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c037070 con 0x7f6a6c0b6940 2024-04-26T23:34:27.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a69400640 1 -- 172.21.15.32:0/3974518151 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c032440 con 0x7f6a6c0b6940 2024-04-26T23:34:27.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a69400640 1 -- 172.21.15.32:0/3974518151 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c032810 con 0x7f6a6c0b6940 2024-04-26T23:34:27.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a70a00640 1 -- 172.21.15.32:0/3974518151 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b6940 msgr2=0x7f6a6c1498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a70a00640 1 --2- 172.21.15.32:0/3974518151 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b6940 0x7f6a6c1498e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0b7550 tx=0x7f6a5c02a140 comp rx=0 tx=0).stop 2024-04-26T23:34:27.912 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a70a00640 1 -- 172.21.15.32:0/3974518151 shutdown_connections 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a70a00640 1 --2- 172.21.15.32:0/3974518151 >> v2:172.21.15.16:3300/0 conn(0x7f6a6c13ff40 0x7f6a6c1403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a70a00640 1 --2- 172.21.15.32:0/3974518151 >> v2:172.21.15.32:3300/0 conn(0x7f6a6c0b5640 0x7f6a6c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a70a00640 1 --2- 172.21.15.32:0/3974518151 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b6940 0x7f6a6c1498e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.908+0000 7f6a70a00640 1 -- 172.21.15.32:0/3974518151 >> 172.21.15.32:0/3974518151 conn(0x7f6a6c068270 msgr2=0x7f6a6c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.909+0000 7f6a70a00640 1 -- 172.21.15.32:0/3974518151 shutdown_connections 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.909+0000 7f6a70a00640 1 -- 172.21.15.32:0/3974518151 wait complete. 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.910+0000 7f6a70a00640 1 Processor -- start 2024-04-26T23:34:27.913 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.910+0000 7f6a70a00640 1 -- start start 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a70a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b5640 0x7f6a6c0b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a70a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a6c0b6940 0x7f6a6c0ba080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a70a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a6c13ff40 0x7f6a6c1de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a70a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0b3d10 con 0x7f6a6c13ff40 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a70a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c1408f0 con 0x7f6a6c0b6940 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a70a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0b3710 con 0x7f6a6c0b5640 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a6a800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b5640 0x7f6a6c0b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a6a800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b5640 0x7f6a6c0b81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39024/0 (socket says 172.21.15.32:39024) 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a6a800640 1 -- 172.21.15.32:0/2124073623 learned_addr learned my addr 172.21.15.32:0/2124073623 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.911+0000 7f6a69e00640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a6c0b6940 0x7f6a6c0ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:27.915 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a6a800640 1 -- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a6c0b6940 msgr2=0x7f6a6c0ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a6a800640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a6c0b6940 0x7f6a6c0ba080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a6a800640 1 -- 172.21.15.32:0/2124073623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a6c13ff40 msgr2=0x7f6a6c1de3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:27.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a6a800640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a6c13ff40 0x7f6a6c1de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:27.916 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a6a800640 1 -- 172.21.15.32:0/2124073623 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c140cd0 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a6a800640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b5640 0x7f6a6c0b81a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000c00 tx=0x7f6a5c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a62a00640 1 -- 172.21.15.32:0/2124073623 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c037040 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a62a00640 1 -- 172.21.15.32:0/2124073623 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c042070 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a62a00640 1 -- 172.21.15.32:0/2124073623 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c030880 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c0b2f40 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.912+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c0ba5c0 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.913+0000 7f6a62a00640 1 -- 172.21.15.32:0/2124073623 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a5c030a20 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.913+0000 7f6a62a00640 1 -- 172.21.15.32:0/2124073623 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6a5c047bd0 con 0x7f6a6c0b5640 2024-04-26T23:34:27.917 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.914+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c1de020 con 0x7f6a6c0b5640 2024-04-26T23:34:27.920 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.917+0000 7f6a62a00640 1 -- 172.21.15.32:0/2124073623 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6a5c047dd0 con 0x7f6a6c0b5640 2024-04-26T23:34:27.970 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:27.966+0000 7f285ec1e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:34:28.000 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:27.997+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7169ab0-32fc-4276-9979-76aee7521000", "id": 1} v 0) -- 0x7f6a6c076600 con 0x7f6a6c0b5640 2024-04-26T23:34:28.007 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.004+0000 7f6a62a00640 1 -- 172.21.15.32:0/2124073623 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7169ab0-32fc-4276-9979-76aee7521000", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6a5c047460 con 0x7f6a6c0b5640 2024-04-26T23:34:28.007 INFO:teuthology.orchestra.run.smithi032.stdout:1 2024-04-26T23:34:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b5640 msgr2=0x7f6a6c0b81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b5640 0x7f6a6c0b81a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c000c00 tx=0x7f6a5c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 shutdown_connections 2024-04-26T23:34:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6a6c0b6940 0x7f6a6c0ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.008 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a6c13ff40 0x7f6a6c1de3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 --2- 172.21.15.32:0/2124073623 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6a6c0b5640 0x7f6a6c0b81a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 >> 172.21.15.32:0/2124073623 conn(0x7f6a6c068270 msgr2=0x7f6a6c1458b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 shutdown_connections 2024-04-26T23:34:28.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.005+0000 7f6a70a00640 1 -- 172.21.15.32:0/2124073623 wait complete. 2024-04-26T23:34:28.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new b7bbf2fa-2955-4531-973a-043a0731a99d 2 2024-04-26T23:34:28.026 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:28.023+0000 7f285ec1e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:34:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.192+0000 7fb93ca00640 1 Processor -- start 2024-04-26T23:34:28.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.192+0000 7fb93ca00640 1 -- start start 2024-04-26T23:34:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.193+0000 7fb93ca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb938073690 0x7fb93814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.193+0000 7fb93ca00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb9380b9340 0x7fb938145720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.193+0000 7fb93ca00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb938073a70 con 0x7fb93809d200 2024-04-26T23:34:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.193+0000 7fb93ca00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb93814c1a0 con 0x7fb938073690 2024-04-26T23:34:28.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.193+0000 7fb93ca00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fb93814c480 con 0x7fb9380b9340 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb937200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb9380b9340 0x7fb938145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb937200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb9380b9340 0x7fb938145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39026/0 (socket says 172.21.15.32:39026) 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb937200640 1 -- 172.21.15.32:0/4286730661 learned_addr learned my addr 172.21.15.32:0/4286730661 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb936800640 1 --2- 172.21.15.32:0/4286730661 >> v2:172.21.15.16:3300/0 conn(0x7fb938073690 0x7fb93814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb937200640 1 -- 172.21.15.32:0/4286730661 >> v2:172.21.15.16:3300/0 conn(0x7fb938073690 msgr2=0x7fb93814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb937200640 1 --2- 172.21.15.32:0/4286730661 >> v2:172.21.15.16:3300/0 conn(0x7fb938073690 0x7fb93814bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb937200640 1 -- 172.21.15.32:0/4286730661 >> v1:172.21.15.16:6789/0 conn(0x7fb93809d200 legacy=0x7fb9380b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:28.198 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.194+0000 7fb937200640 1 -- 172.21.15.32:0/4286730661 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9380ba3f0 con 0x7fb9380b9340 2024-04-26T23:34:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.196+0000 7fb937200640 1 --2- 172.21.15.32:0/4286730661 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb9380b9340 0x7fb938145720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb930009e50 tx=0x7fb93002a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba9d82890b56a336 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.196+0000 7fb935400640 1 -- 172.21.15.32:0/4286730661 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930036070 con 0x7fb9380b9340 2024-04-26T23:34:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.196+0000 7fb935400640 1 -- 172.21.15.32:0/4286730661 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb930031600 con 0x7fb9380b9340 2024-04-26T23:34:28.199 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.196+0000 7fb935400640 1 -- 172.21.15.32:0/4286730661 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9300319d0 con 0x7fb9380b9340 2024-04-26T23:34:28.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 -- 172.21.15.32:0/4286730661 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb9380b9340 msgr2=0x7fb938145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 --2- 172.21.15.32:0/4286730661 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb9380b9340 0x7fb938145720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb930009e50 tx=0x7fb93002a630 comp rx=0 tx=0).stop 2024-04-26T23:34:28.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 -- 172.21.15.32:0/4286730661 shutdown_connections 2024-04-26T23:34:28.200 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 --2- 172.21.15.32:0/4286730661 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb9380b9340 0x7fb938145720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 --2- 172.21.15.32:0/4286730661 >> v2:172.21.15.16:3300/0 conn(0x7fb938073690 0x7fb93814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 -- 172.21.15.32:0/4286730661 >> 172.21.15.32:0/4286730661 conn(0x7fb9380bdc10 msgr2=0x7fb9380be020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:28.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 -- 172.21.15.32:0/4286730661 shutdown_connections 2024-04-26T23:34:28.201 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.197+0000 7fb93ca00640 1 -- 172.21.15.32:0/4286730661 wait complete. 2024-04-26T23:34:28.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.199+0000 7fb93ca00640 1 Processor -- start 2024-04-26T23:34:28.202 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.199+0000 7fb93ca00640 1 -- start start 2024-04-26T23:34:28.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb93ca00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb938073690 0x7fb938146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.204 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb93ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb93809d200 0x7fb9380b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb93ca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9380b9340 0x7fb9381e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb93ca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb938146030 con 0x7fb93809d200 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb93ca00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fb938145eb0 con 0x7fb9380b9340 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb93ca00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fb9381461b0 con 0x7fb938073690 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb936800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb938073690 0x7fb938146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.200+0000 7fb936800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb938073690 0x7fb938146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39028/0 (socket says 172.21.15.32:39028) 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb936800640 1 -- 172.21.15.32:0/4201711137 learned_addr learned my addr 172.21.15.32:0/4201711137 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb937200640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9380b9340 0x7fb9381e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb935e00640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb93809d200 0x7fb9380b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb936800640 1 -- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9380b9340 msgr2=0x7fb9381e1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb936800640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9380b9340 0x7fb9381e1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb936800640 1 -- 172.21.15.32:0/4201711137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb93809d200 msgr2=0x7fb9380b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.205 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb936800640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb93809d200 0x7fb9380b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb936800640 1 -- 172.21.15.32:0/4201711137 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb938147550 con 0x7fb938073690 2024-04-26T23:34:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb935e00640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb93809d200 0x7fb9380b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb937200640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9380b9340 0x7fb9381e1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:28.206 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.201+0000 7fb936800640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb938073690 0x7fb938146630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb92800d620 tx=0x7fb92800dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.202+0000 7fb92ea00640 1 -- 172.21.15.32:0/4201711137 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92800b620 con 0x7fb938073690 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.202+0000 7fb92ea00640 1 -- 172.21.15.32:0/4201711137 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb928019070 con 0x7fb938073690 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.202+0000 7fb92ea00640 1 -- 172.21.15.32:0/4201711137 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92800ba00 con 0x7fb938073690 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.202+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb938147830 con 0x7fb938073690 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.202+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9380b7510 con 0x7fb938073690 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.202+0000 7fb92ea00640 1 -- 172.21.15.32:0/4201711137 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb92800bba0 con 0x7fb938073690 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.202+0000 7fb92ea00640 1 -- 172.21.15.32:0/4201711137 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb92801e880 con 0x7fb938073690 2024-04-26T23:34:28.207 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.203+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb938075b40 con 0x7fb938073690 2024-04-26T23:34:28.209 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.206+0000 7fb92ea00640 1 -- 172.21.15.32:0/4201711137 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb938075b40 con 0x7fb938073690 2024-04-26T23:34:28.309 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.305+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b7bbf2fa-2955-4531-973a-043a0731a99d", "id": 2} v 0) -- 0x7fb93814b3b0 con 0x7fb938073690 2024-04-26T23:34:28.316 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.312+0000 7fb92ea00640 1 -- 172.21.15.32:0/4201711137 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7bbf2fa-2955-4531-973a-043a0731a99d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb93814b3b0 con 0x7fb938073690 2024-04-26T23:34:28.316 INFO:teuthology.orchestra.run.smithi032.stdout:2 2024-04-26T23:34:28.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb938073690 msgr2=0x7fb938146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.317 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb938073690 0x7fb938146630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb92800d620 tx=0x7fb92800dae0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 shutdown_connections 2024-04-26T23:34:28.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb9380b9340 0x7fb9381e1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb93809d200 0x7fb9380b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 --2- 172.21.15.32:0/4201711137 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb938073690 0x7fb938146630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 >> 172.21.15.32:0/4201711137 conn(0x7fb9380bdc10 msgr2=0x7fb93809f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:28.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 shutdown_connections 2024-04-26T23:34:28.318 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.314+0000 7fb93ca00640 1 -- 172.21.15.32:0/4201711137 wait complete. 2024-04-26T23:34:28.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new a29d29a9-7ff8-4830-a841-b5d45f03e19f 3 2024-04-26T23:34:28.340 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:28.337+0000 7f61c8b20040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:34:28.461 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:28.457+0000 7f61c8b20040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:34:28.518 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:28.515+0000 7f61c8b20040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:34:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.527+0000 7f7703400640 1 Processor -- start 2024-04-26T23:34:28.531 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.528+0000 7f7703400640 1 -- start start 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f7703400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76fc0bbb70 0x7f76fc0bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f7703400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc09d4f0 con 0x7f76fc09d110 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f7703400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc09c660 con 0x7f76fc09ba20 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f7703400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f76fc09c940 con 0x7f76fc0bbb70 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f76fbe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76fc0bbb70 0x7f76fc0bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f76fbe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76fc0bbb70 0x7f76fc0bd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40706/0 (socket says 172.21.15.32:40706) 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f7701400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f76fc09ba20 0x7f76fc153020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38810/0 (socket says 172.21.15.32:38810) 2024-04-26T23:34:28.533 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.529+0000 7f76fbe00640 1 -- 172.21.15.32:0/1411350625 learned_addr learned my addr 172.21.15.32:0/1411350625 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:28.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.530+0000 7f76fbe00640 1 -- 172.21.15.32:0/1411350625 >> v1:172.21.15.32:6789/0 conn(0x7f76fc09ba20 legacy=0x7f76fc153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.530+0000 7f76fbe00640 1 -- 172.21.15.32:0/1411350625 >> v1:172.21.15.16:6789/0 conn(0x7f76fc09d110 legacy=0x7f76fc142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.534 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.530+0000 7f76fbe00640 1 -- 172.21.15.32:0/1411350625 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc09cc20 con 0x7f76fc0bbb70 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.531+0000 7f76fbe00640 1 --2- 172.21.15.32:0/1411350625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 0x7f76fc0bd2b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009870 tx=0x7f76e802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ef6dbedc61e225 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.531+0000 7f76fb400640 1 -- 172.21.15.32:0/1411350625 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8037070 con 0x7f76fc0bbb70 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.531+0000 7f76fb400640 1 -- 172.21.15.32:0/1411350625 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e8032440 con 0x7f76fc0bbb70 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.531+0000 7f76fb400640 1 -- 172.21.15.32:0/1411350625 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8032810 con 0x7f76fc0bbb70 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.532+0000 7f7703400640 1 -- 172.21.15.32:0/1411350625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 msgr2=0x7f76fc0bd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.532+0000 7f7703400640 1 --2- 172.21.15.32:0/1411350625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 0x7f76fc0bd2b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009870 tx=0x7f76e802a270 comp rx=0 tx=0).stop 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.532+0000 7f7703400640 1 -- 172.21.15.32:0/1411350625 shutdown_connections 2024-04-26T23:34:28.535 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.532+0000 7f7703400640 1 --2- 172.21.15.32:0/1411350625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 0x7f76fc0bd2b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.532+0000 7f7703400640 1 -- 172.21.15.32:0/1411350625 >> 172.21.15.32:0/1411350625 conn(0x7f76fc068910 msgr2=0x7f76fc09f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:28.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.532+0000 7f7703400640 1 -- 172.21.15.32:0/1411350625 shutdown_connections 2024-04-26T23:34:28.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.532+0000 7f7703400640 1 -- 172.21.15.32:0/1411350625 wait complete. 2024-04-26T23:34:28.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.533+0000 7f7703400640 1 Processor -- start 2024-04-26T23:34:28.536 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.533+0000 7f7703400640 1 -- start start 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7703400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f76fc09ba20 0x7f76fc1e1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7703400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76fc09d110 0x7f76fc1e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7703400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 0x7f76fc13db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7703400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc0a3130 con 0x7f76fc09d110 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7703400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc0a2fb0 con 0x7f76fc0bbb70 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7703400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f76fc0bd7f0 con 0x7f76fc09ba20 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7700a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f76fc09ba20 0x7f76fc1e1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7700a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f76fc09ba20 0x7f76fc1e1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39044/0 (socket says 172.21.15.32:39044) 2024-04-26T23:34:28.538 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.534+0000 7f7700a00640 1 -- 172.21.15.32:0/3004773489 learned_addr learned my addr 172.21.15.32:0/3004773489 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:28.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f7701400640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 0x7f76fc13db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.539 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f76fbe00640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76fc09d110 0x7f76fc1e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f7700a00640 1 -- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 msgr2=0x7f76fc13db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f7700a00640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 0x7f76fc13db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f7700a00640 1 -- 172.21.15.32:0/3004773489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76fc09d110 msgr2=0x7f76fc1e2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f7700a00640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76fc09d110 0x7f76fc1e2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f7700a00640 1 -- 172.21.15.32:0/3004773489 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc0ba910 con 0x7f76fc09ba20 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.535+0000 7f7700a00640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f76fc09ba20 0x7f76fc1e1bc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76f000c480 tx=0x7f76f000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.536+0000 7f76f8c00640 1 -- 172.21.15.32:0/3004773489 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f00052d0 con 0x7f76fc09ba20 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.536+0000 7f76f8c00640 1 -- 172.21.15.32:0/3004773489 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f0005470 con 0x7f76fc09ba20 2024-04-26T23:34:28.540 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.536+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76fc144680 con 0x7f76fc09ba20 2024-04-26T23:34:28.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.536+0000 7f76f8c00640 1 -- 172.21.15.32:0/3004773489 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0012850 con 0x7f76fc09ba20 2024-04-26T23:34:28.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.536+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76fc1443a0 con 0x7f76fc09ba20 2024-04-26T23:34:28.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.536+0000 7f76f8c00640 1 -- 172.21.15.32:0/3004773489 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f76f00129f0 con 0x7f76fc09ba20 2024-04-26T23:34:28.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.536+0000 7f76f8c00640 1 -- 172.21.15.32:0/3004773489 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f76f0012ce0 con 0x7f76fc09ba20 2024-04-26T23:34:28.541 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.537+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76fc09c150 con 0x7f76fc09ba20 2024-04-26T23:34:28.543 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.540+0000 7f76f8c00640 1 -- 172.21.15.32:0/3004773489 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f76fc09c150 con 0x7f76fc09ba20 2024-04-26T23:34:28.642 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.639+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a29d29a9-7ff8-4830-a841-b5d45f03e19f", "id": 3} v 0) -- 0x7f76fc076670 con 0x7f76fc09ba20 2024-04-26T23:34:28.648 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.645+0000 7f76f8c00640 1 -- 172.21.15.32:0/3004773489 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a29d29a9-7ff8-4830-a841-b5d45f03e19f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f76f00036e0 con 0x7f76fc09ba20 2024-04-26T23:34:28.649 INFO:teuthology.orchestra.run.smithi032.stdout:3 2024-04-26T23:34:28.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f76fc09ba20 msgr2=0x7f76fc1e1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f76fc09ba20 0x7f76fc1e1bc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76f000c480 tx=0x7f76f000c940 comp rx=0 tx=0).stop 2024-04-26T23:34:28.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 shutdown_connections 2024-04-26T23:34:28.650 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76fc0bbb70 0x7f76fc13db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76fc09d110 0x7f76fc1e2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 --2- 172.21.15.32:0/3004773489 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f76fc09ba20 0x7f76fc1e1bc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 >> 172.21.15.32:0/3004773489 conn(0x7f76fc068910 msgr2=0x7f76fc0bdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:28.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 shutdown_connections 2024-04-26T23:34:28.651 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.647+0000 7f7703400640 1 -- 172.21.15.32:0/3004773489 wait complete. 2024-04-26T23:34:28.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new 2cdbea5e-f1c8-4868-a924-ad749b7d5404 4 2024-04-26T23:34:28.742 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:28.739+0000 7f61c8b20040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:34:28.810 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:28.807+0000 7f61c8b20040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:34:28.876 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:28.873+0000 7f61c8b20040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:34:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.894+0000 7fe39da00640 1 Processor -- start 2024-04-26T23:34:28.898 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.895+0000 7fe39da00640 1 -- start start 2024-04-26T23:34:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.896+0000 7fe39da00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe398075550 0x7fe3981497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.896+0000 7fe39da00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3980b4500 con 0x7fe3980b0940 2024-04-26T23:34:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.896+0000 7fe39da00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3980b11b0 con 0x7fe3980b0da0 2024-04-26T23:34:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.896+0000 7fe39da00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fe398070b00 con 0x7fe398075550 2024-04-26T23:34:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.896+0000 7fe397e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe398075550 0x7fe3981497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.896+0000 7fe39d000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe3980b0da0 0x7fe3980b3df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38824/0 (socket says 172.21.15.32:38824) 2024-04-26T23:34:28.900 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.896+0000 7fe39d000640 1 -- 172.21.15.32:0/4160417857 learned_addr learned my addr 172.21.15.32:0/4160417857 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-04-26T23:34:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.897+0000 7fe397e00640 1 -- 172.21.15.32:0/4160417857 >> v1:172.21.15.32:6789/0 conn(0x7fe3980b0da0 legacy=0x7fe3980b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.897+0000 7fe397e00640 1 -- 172.21.15.32:0/4160417857 >> v1:172.21.15.16:6789/0 conn(0x7fe3980b0940 legacy=0x7fe3980b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.897+0000 7fe397e00640 1 -- 172.21.15.32:0/4160417857 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe398075930 con 0x7fe398075550 2024-04-26T23:34:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.898+0000 7fe397e00640 1 --2- 172.21.15.32:0/4160417857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe3981497d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10b94a0ca6741feb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.898+0000 7fe397400640 1 -- 172.21.15.32:0/4160417857 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388037070 con 0x7fe398075550 2024-04-26T23:34:28.901 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.898+0000 7fe397400640 1 -- 172.21.15.32:0/4160417857 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38802ae50 con 0x7fe398075550 2024-04-26T23:34:28.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.898+0000 7fe397400640 1 -- 172.21.15.32:0/4160417857 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388032660 con 0x7fe398075550 2024-04-26T23:34:28.902 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.899+0000 7fe39da00640 1 -- 172.21.15.32:0/4160417857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 msgr2=0x7fe3981497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.899+0000 7fe39da00640 1 --2- 172.21.15.32:0/4160417857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe3981497d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802a100 comp rx=0 tx=0).stop 2024-04-26T23:34:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.899+0000 7fe39da00640 1 -- 172.21.15.32:0/4160417857 shutdown_connections 2024-04-26T23:34:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.899+0000 7fe39da00640 1 --2- 172.21.15.32:0/4160417857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe3981497d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.899+0000 7fe39da00640 1 -- 172.21.15.32:0/4160417857 >> 172.21.15.32:0/4160417857 conn(0x7fe398068a10 msgr2=0x7fe3980ba0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.899+0000 7fe39da00640 1 -- 172.21.15.32:0/4160417857 shutdown_connections 2024-04-26T23:34:28.903 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.899+0000 7fe39da00640 1 -- 172.21.15.32:0/4160417857 wait complete. 2024-04-26T23:34:28.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.901+0000 7fe39da00640 1 Processor -- start 2024-04-26T23:34:28.904 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.901+0000 7fe39da00640 1 -- start start 2024-04-26T23:34:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe39da00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe398148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe39da00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe3980b0940 0x7fe3981de790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe39da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3980b0da0 0x7fe3981decd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe39da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe3980b6490 con 0x7fe3980b0da0 2024-04-26T23:34:28.906 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe39da00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fe3980b5400 con 0x7fe398075550 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe39da00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fe398071bb0 con 0x7fe3980b0940 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe397e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe398148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe397e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe398148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40730/0 (socket says 172.21.15.32:40730) 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe397e00640 1 -- 172.21.15.32:0/4231347759 learned_addr learned my addr 172.21.15.32:0/4231347759 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.902+0000 7fe38fe00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe3980b0940 0x7fe3981de790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.903+0000 7fe39d000640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3980b0da0 0x7fe3981decd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.903+0000 7fe397e00640 1 -- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe3980b0940 msgr2=0x7fe3981de790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.903+0000 7fe397e00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe3980b0940 0x7fe3981de790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.903+0000 7fe397e00640 1 -- 172.21.15.32:0/4231347759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3980b0da0 msgr2=0x7fe3981decd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.903+0000 7fe397e00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3980b0da0 0x7fe3981decd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.907 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.903+0000 7fe397e00640 1 -- 172.21.15.32:0/4231347759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3980b30a0 con 0x7fe398075550 2024-04-26T23:34:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.903+0000 7fe397e00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe398148b50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe3880098c0 tx=0x7fe3880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.904+0000 7fe394c00640 1 -- 172.21.15.32:0/4231347759 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388041070 con 0x7fe398075550 2024-04-26T23:34:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.904+0000 7fe394c00640 1 -- 172.21.15.32:0/4231347759 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38803c670 con 0x7fe398075550 2024-04-26T23:34:28.908 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.904+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3980b1c70 con 0x7fe398075550 2024-04-26T23:34:28.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.904+0000 7fe394c00640 1 -- 172.21.15.32:0/4231347759 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388037040 con 0x7fe398075550 2024-04-26T23:34:28.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.904+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3980b2330 con 0x7fe398075550 2024-04-26T23:34:28.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.904+0000 7fe394c00640 1 -- 172.21.15.32:0/4231347759 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe388044070 con 0x7fe398075550 2024-04-26T23:34:28.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.904+0000 7fe394c00640 1 -- 172.21.15.32:0/4231347759 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe388046450 con 0x7fe398075550 2024-04-26T23:34:28.909 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.905+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe398076600 con 0x7fe398075550 2024-04-26T23:34:28.911 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.907+0000 7fe394c00640 1 -- 172.21.15.32:0/4231347759 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe38803ca60 con 0x7fe398075550 2024-04-26T23:34:28.990 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.987+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2cdbea5e-f1c8-4868-a924-ad749b7d5404", "id": 4} v 0) -- 0x7fe3980b42e0 con 0x7fe398075550 2024-04-26T23:34:28.996 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.993+0000 7fe394c00640 1 -- 172.21.15.32:0/4231347759 <== mon.1 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2cdbea5e-f1c8-4868-a924-ad749b7d5404", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe38803cc40 con 0x7fe398075550 2024-04-26T23:34:28.996 INFO:teuthology.orchestra.run.smithi032.stdout:4 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 msgr2=0x7fe398148b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe398148b50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe3880098c0 tx=0x7fe3880046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 shutdown_connections 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3980b0da0 0x7fe3981decd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe3980b0940 0x7fe3981de790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 --2- 172.21.15.32:0/4231347759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398075550 0x7fe398148b50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 >> 172.21.15.32:0/4231347759 conn(0x7fe398068a10 msgr2=0x7fe3980b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.994+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 shutdown_connections 2024-04-26T23:34:28.998 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:28.995+0000 7fe39da00640 1 -- 172.21.15.32:0/4231347759 wait complete. 2024-04-26T23:34:29.014 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6 5 2024-04-26T23:34:29.015 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:29.012+0000 7f61c8b20040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:34:29.055 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:29.052+0000 7f285ec1e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:34:29.171 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:29.168+0000 7f285ec1e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:34:29.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.182+0000 7fb5f7e00640 1 Processor -- start 2024-04-26T23:34:29.185 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.182+0000 7fb5f7e00640 1 -- start start 2024-04-26T23:34:29.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.183+0000 7fb5f7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb5f8073690 0x7fb5f814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.183+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f809d200 0x7fb5f80b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.187 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.183+0000 7fb5f7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb5f80b9170 0x7fb5f8145720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.183+0000 7fb5f7e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f80b9600 con 0x7fb5f8073690 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.183+0000 7fb5f7e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f8073a70 con 0x7fb5f80b9170 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.183+0000 7fb5f7e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f814c1a0 con 0x7fb5f809d200 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f6000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f809d200 0x7fb5f80b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb5f80b9170 0x7fb5f8145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb5f80b9170 0x7fb5f8145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40744/0 (socket says 172.21.15.32:40744) 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 -- 172.21.15.32:0/3776083502 learned_addr learned my addr 172.21.15.32:0/3776083502 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f6000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f809d200 0x7fb5f80b8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39058/0 (socket says 172.21.15.32:39058) 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f6a00640 1 --2- 172.21.15.32:0/3776083502 >> v2:172.21.15.16:3300/0 conn(0x7fb5f8073690 0x7fb5f814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 -- 172.21.15.32:0/3776083502 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f809d200 msgr2=0x7fb5f80b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 --2- 172.21.15.32:0/3776083502 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f809d200 0x7fb5f80b8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 -- 172.21.15.32:0/3776083502 >> v2:172.21.15.16:3300/0 conn(0x7fb5f8073690 msgr2=0x7fb5f814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 --2- 172.21.15.32:0/3776083502 >> v2:172.21.15.16:3300/0 conn(0x7fb5f8073690 0x7fb5f814bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.188 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.184+0000 7fb5f7400640 1 -- 172.21.15.32:0/3776083502 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f814c480 con 0x7fb5f80b9170 2024-04-26T23:34:29.189 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.185+0000 7fb5f7400640 1 --2- 172.21.15.32:0/3776083502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f8145720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8149720 tx=0x7fb5f002a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21c2c06c6ac38925 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.185+0000 7fb5f5600640 1 -- 172.21.15.32:0/3776083502 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0037070 con 0x7fb5f80b9170 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f5600640 1 -- 172.21.15.32:0/3776083502 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f0032440 con 0x7fb5f80b9170 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f5600640 1 -- 172.21.15.32:0/3776083502 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0032810 con 0x7fb5f80b9170 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 -- 172.21.15.32:0/3776083502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 msgr2=0x7fb5f8145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/3776083502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f8145720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8149720 tx=0x7fb5f002a140 comp rx=0 tx=0).stop 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 -- 172.21.15.32:0/3776083502 shutdown_connections 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/3776083502 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f8145720 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/3776083502 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f809d200 0x7fb5f80b8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/3776083502 >> v2:172.21.15.16:3300/0 conn(0x7fb5f8073690 0x7fb5f814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 -- 172.21.15.32:0/3776083502 >> 172.21.15.32:0/3776083502 conn(0x7fb5f80bdc10 msgr2=0x7fb5f80be020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 -- 172.21.15.32:0/3776083502 shutdown_connections 2024-04-26T23:34:29.190 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.186+0000 7fb5f7e00640 1 -- 172.21.15.32:0/3776083502 wait complete. 2024-04-26T23:34:29.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.188+0000 7fb5f7e00640 1 Processor -- start 2024-04-26T23:34:29.191 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.188+0000 7fb5f7e00640 1 -- start start 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f8073690 0x7fb5f80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5f809d200 0x7fb5f81de500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f81dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8145de0 con 0x7fb5f809d200 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8145c60 con 0x7fb5f80b9170 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f8145f60 con 0x7fb5f8073690 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f8073690 0x7fb5f80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f8073690 0x7fb5f80b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39060/0 (socket says 172.21.15.32:39060) 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 -- 172.21.15.32:0/304165519 learned_addr learned my addr 172.21.15.32:0/304165519 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:29.194 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7400640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f81dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6000640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5f809d200 0x7fb5f81de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 -- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 msgr2=0x7fb5f81dea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f81dea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 -- 172.21.15.32:0/304165519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5f809d200 msgr2=0x7fb5f81de500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5f809d200 0x7fb5f81de500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f6a00640 1 -- 172.21.15.32:0/304165519 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f80a1300 con 0x7fb5f8073690 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.189+0000 7fb5f7400640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f81dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.190+0000 7fb5f6a00640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f8073690 0x7fb5f80b27e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800d830 tx=0x7fb5e800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.190+0000 7fb5ef400640 1 -- 172.21.15.32:0/304165519 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800b6c0 con 0x7fb5f8073690 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.190+0000 7fb5ef400640 1 -- 172.21.15.32:0/304165519 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8019070 con 0x7fb5f8073690 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.190+0000 7fb5ef400640 1 -- 172.21.15.32:0/304165519 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800ba80 con 0x7fb5f8073690 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.190+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f80b3530 con 0x7fb5f8073690 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.190+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f80b19d0 con 0x7fb5f8073690 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.190+0000 7fb5ef400640 1 -- 172.21.15.32:0/304165519 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb5e801e460 con 0x7fb5f8073690 2024-04-26T23:34:29.195 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.191+0000 7fb5ef400640 1 -- 172.21.15.32:0/304165519 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fb5e8014cd0 con 0x7fb5f8073690 2024-04-26T23:34:29.196 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.192+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f8076600 con 0x7fb5f8073690 2024-04-26T23:34:29.197 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.194+0000 7fb5ef400640 1 -- 172.21.15.32:0/304165519 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb5e8014750 con 0x7fb5f8073690 2024-04-26T23:34:29.228 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:29.225+0000 7f285ec1e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:34:29.277 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.273+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6", "id": 5} v 0) -- 0x7fb5f81de120 con 0x7fb5f8073690 2024-04-26T23:34:29.284 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.281+0000 7fb5ef400640 1 -- 172.21.15.32:0/304165519 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fb5e8014930 con 0x7fb5f8073690 2024-04-26T23:34:29.284 INFO:teuthology.orchestra.run.smithi032.stdout:5 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.282+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f8073690 msgr2=0x7fb5f80b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.282+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f8073690 0x7fb5f80b27e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800d830 tx=0x7fb5e800dcf0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.282+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 shutdown_connections 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.282+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5f80b9170 0x7fb5f81dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.282+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5f809d200 0x7fb5f81de500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.282+0000 7fb5f7e00640 1 --2- 172.21.15.32:0/304165519 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb5f8073690 0x7fb5f80b27e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.282+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 >> 172.21.15.32:0/304165519 conn(0x7fb5f80bdc10 msgr2=0x7fb5f809fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.283+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 shutdown_connections 2024-04-26T23:34:29.286 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.283+0000 7fb5f7e00640 1 -- 172.21.15.32:0/304165519 wait complete. 2024-04-26T23:34:29.302 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new 5430be5e-05be-4f71-a48e-8e295ec43476 6 2024-04-26T23:34:29.444 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:29.441+0000 7f285ec1e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:34:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.484+0000 7fc78f800640 1 Processor -- start 2024-04-26T23:34:29.488 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.484+0000 7fc78f800640 1 -- start start 2024-04-26T23:34:29.490 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.486+0000 7fc78f800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc7880b5620 0x7fc788145db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.486+0000 7fc78f800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7880b5e60 0x7fc788072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.486+0000 7fc78f800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7880736c0 con 0x7fc7880b5a00 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.486+0000 7fc78f800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc7880b62b0 con 0x7fc7880b5620 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.486+0000 7fc78f800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fc788145920 con 0x7fc7880b5e60 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.486+0000 7fc78d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7880b5e60 0x7fc788072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc787e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc7880b5a00 0x7fc788071980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38830/0 (socket says 172.21.15.32:38830) 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc78d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc7880b5e60 0x7fc788072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40756/0 (socket says 172.21.15.32:40756) 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc787e00640 1 -- 172.21.15.32:0/869414784 learned_addr learned my addr 172.21.15.32:0/869414784 (peer_addr_for_me v1:172.21.15.32:0/0) 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc78ce00640 1 --2- 172.21.15.32:0/869414784 >> v2:172.21.15.16:3300/0 conn(0x7fc7880b5620 0x7fc788145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc78d800640 1 -- 172.21.15.32:0/869414784 >> v2:172.21.15.16:3300/0 conn(0x7fc7880b5620 msgr2=0x7fc788145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc78d800640 1 --2- 172.21.15.32:0/869414784 >> v2:172.21.15.16:3300/0 conn(0x7fc7880b5620 0x7fc788145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc78d800640 1 -- 172.21.15.32:0/869414784 >> v1:172.21.15.32:6789/0 conn(0x7fc7880b5a00 legacy=0x7fc788071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.487+0000 7fc78d800640 1 -- 172.21.15.32:0/869414784 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7881452d0 con 0x7fc7880b5e60 2024-04-26T23:34:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.488+0000 7fc78d800640 1 --2- 172.21.15.32:0/869414784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5e60 0x7fc788072090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7880b6860 tx=0x7fc78002c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=516bd2acb5fa857a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.488+0000 7fc787400640 1 -- 172.21.15.32:0/869414784 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780007740 con 0x7fc7880b5e60 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.488+0000 7fc787400640 1 -- 172.21.15.32:0/869414784 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7800078e0 con 0x7fc7880b5e60 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.488+0000 7fc787400640 1 -- 172.21.15.32:0/869414784 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780007cb0 con 0x7fc7880b5e60 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 -- 172.21.15.32:0/869414784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5e60 msgr2=0x7fc788072090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 --2- 172.21.15.32:0/869414784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5e60 0x7fc788072090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7880b6860 tx=0x7fc78002c800 comp rx=0 tx=0).stop 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 -- 172.21.15.32:0/869414784 shutdown_connections 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 --2- 172.21.15.32:0/869414784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5e60 0x7fc788072090 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 --2- 172.21.15.32:0/869414784 >> v2:172.21.15.16:3300/0 conn(0x7fc7880b5620 0x7fc788145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 -- 172.21.15.32:0/869414784 >> 172.21.15.32:0/869414784 conn(0x7fc78806e060 msgr2=0x7fc78806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 -- 172.21.15.32:0/869414784 shutdown_connections 2024-04-26T23:34:29.493 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.489+0000 7fc78f800640 1 -- 172.21.15.32:0/869414784 wait complete. 2024-04-26T23:34:29.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.491+0000 7fc78f800640 1 Processor -- start 2024-04-26T23:34:29.494 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.491+0000 7fc78f800640 1 -- start start 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78f800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7880b5620 0x7fc7880af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78f800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5a00 0x7fc7881ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78f800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7880b5e60 0x7fc7881de480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78f800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc7880725d0 con 0x7fc7880b5e60 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78f800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fc788073320 con 0x7fc7880b5a00 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78f800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc788072750 con 0x7fc7880b5620 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc787e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5a00 0x7fc7881ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78ce00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7880b5620 0x7fc7880af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc787e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5a00 0x7fc7881ddf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40758/0 (socket says 172.21.15.32:40758) 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc78ce00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7880b5620 0x7fc7880af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39076/0 (socket says 172.21.15.32:39076) 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.492+0000 7fc787e00640 1 -- 172.21.15.32:0/1949071549 learned_addr learned my addr 172.21.15.32:0/1949071549 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:29.496 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc78d800640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7880b5e60 0x7fc7881de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.497 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc787e00640 1 -- 172.21.15.32:0/1949071549 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7880b5620 msgr2=0x7fc7880af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc787e00640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7880b5620 0x7fc7880af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc787e00640 1 -- 172.21.15.32:0/1949071549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7880b5e60 msgr2=0x7fc7881de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc787e00640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7880b5e60 0x7fc7881de480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc787e00640 1 -- 172.21.15.32:0/1949071549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7881427b0 con 0x7fc7880b5a00 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc78d800640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7880b5e60 0x7fc7881de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc787e00640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5a00 0x7fc7881ddf40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c400 tx=0x7fc77400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc784c00640 1 -- 172.21.15.32:0/1949071549 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774017070 con 0x7fc7880b5a00 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc784c00640 1 -- 172.21.15.32:0/1949071549 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc774005ce0 con 0x7fc7880b5a00 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc784c00640 1 -- 172.21.15.32:0/1949071549 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7740072f0 con 0x7fc7880b5a00 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.493+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7880ae8a0 con 0x7fc7880b5a00 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.494+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7880af150 con 0x7fc7880b5a00 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.494+0000 7fc784c00640 1 -- 172.21.15.32:0/1949071549 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc77401a070 con 0x7fc7880b5a00 2024-04-26T23:34:29.498 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.494+0000 7fc784c00640 1 -- 172.21.15.32:0/1949071549 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc7740129f0 con 0x7fc7880b5a00 2024-04-26T23:34:29.499 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.495+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc788076670 con 0x7fc7880b5a00 2024-04-26T23:34:29.500 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.497+0000 7fc784c00640 1 -- 172.21.15.32:0/1949071549 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc774021020 con 0x7fc7880b5a00 2024-04-26T23:34:29.511 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:29.508+0000 7f61c8b20040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T23:34:29.520 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:29.517+0000 7f285ec1e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:34:29.583 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.579+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5430be5e-05be-4f71-a48e-8e295ec43476", "id": 6} v 0) -- 0x7fc7881429b0 con 0x7fc7880b5a00 2024-04-26T23:34:29.589 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.586+0000 7fc784c00640 1 -- 172.21.15.32:0/1949071549 <== mon.1 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5430be5e-05be-4f71-a48e-8e295ec43476", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc7740075e0 con 0x7fc7880b5a00 2024-04-26T23:34:29.590 INFO:teuthology.orchestra.run.smithi032.stdout:6 2024-04-26T23:34:29.590 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:29.587+0000 7f285ec1e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:34:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.587+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5a00 msgr2=0x7fc7881ddf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.587+0000 7fc78f800640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5a00 0x7fc7881ddf40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc77400c400 tx=0x7fc77400c8c0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.588+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 shutdown_connections 2024-04-26T23:34:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.588+0000 7fc78f800640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7880b5a00 0x7fc7881ddf40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.588+0000 7fc78f800640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7880b5e60 0x7fc7881de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.588+0000 7fc78f800640 1 --2- 172.21.15.32:0/1949071549 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7880b5620 0x7fc7880af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.591 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.588+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 >> 172.21.15.32:0/1949071549 conn(0x7fc78806e060 msgr2=0x7fc7880bb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:29.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.588+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 shutdown_connections 2024-04-26T23:34:29.592 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.588+0000 7fc78f800640 1 -- 172.21.15.32:0/1949071549 wait complete. 2024-04-26T23:34:29.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd new e7fdc82b-772b-4633-bff6-777d58014535 7 2024-04-26T23:34:29.724 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:29.721+0000 7f285ec1e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:34:29.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.791+0000 7fc099800640 1 Processor -- start 2024-04-26T23:34:29.795 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.791+0000 7fc099800640 1 -- start start 2024-04-26T23:34:29.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.792+0000 7fc099800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0940ba110 0x7fc0940b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.792+0000 7fc099800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0941484d0 0x7fc0941488e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.796 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.792+0000 7fc099800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0940bb230 con 0x7fc0940bae50 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.792+0000 7fc099800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc0940b51e0 con 0x7fc0941484d0 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.792+0000 7fc099800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fc0940b54c0 con 0x7fc0940ba110 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc093400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0940ba110 0x7fc0940b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc093400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0940ba110 0x7fc0940b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:40772/0 (socket says 172.21.15.32:40772) 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc093400640 1 -- 172.21.15.32:0/2397605830 learned_addr learned my addr 172.21.15.32:0/2397605830 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc098e00640 1 --2- 172.21.15.32:0/2397605830 >> v2:172.21.15.16:3300/0 conn(0x7fc0941484d0 0x7fc0941488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc093400640 1 -- 172.21.15.32:0/2397605830 >> v2:172.21.15.16:3300/0 conn(0x7fc0941484d0 msgr2=0x7fc0941488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc093400640 1 --2- 172.21.15.32:0/2397605830 >> v2:172.21.15.16:3300/0 conn(0x7fc0941484d0 0x7fc0941488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc093400640 1 -- 172.21.15.32:0/2397605830 >> v1:172.21.15.16:6789/0 conn(0x7fc0940bae50 legacy=0x7fc0941422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:29.797 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.793+0000 7fc093400640 1 -- 172.21.15.32:0/2397605830 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0940b57a0 con 0x7fc0940ba110 2024-04-26T23:34:29.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.794+0000 7fc093400640 1 --2- 172.21.15.32:0/2397605830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940ba110 0x7fc0940b6610 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc0940b7180 tx=0x7fc08002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73bbe6079b0813a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:29.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.794+0000 7fc092a00640 1 -- 172.21.15.32:0/2397605830 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080037070 con 0x7fc0940ba110 2024-04-26T23:34:29.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.794+0000 7fc092a00640 1 -- 172.21.15.32:0/2397605830 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08002ae20 con 0x7fc0940ba110 2024-04-26T23:34:29.798 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.794+0000 7fc092a00640 1 -- 172.21.15.32:0/2397605830 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080032660 con 0x7fc0940ba110 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 -- 172.21.15.32:0/2397605830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940ba110 msgr2=0x7fc0940b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 --2- 172.21.15.32:0/2397605830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940ba110 0x7fc0940b6610 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc0940b7180 tx=0x7fc08002a110 comp rx=0 tx=0).stop 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 -- 172.21.15.32:0/2397605830 shutdown_connections 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 --2- 172.21.15.32:0/2397605830 >> v2:172.21.15.16:3300/0 conn(0x7fc0941484d0 0x7fc0941488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 --2- 172.21.15.32:0/2397605830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940ba110 0x7fc0940b6610 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 -- 172.21.15.32:0/2397605830 >> 172.21.15.32:0/2397605830 conn(0x7fc0940684b0 msgr2=0x7fc0940688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 -- 172.21.15.32:0/2397605830 shutdown_connections 2024-04-26T23:34:29.799 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.795+0000 7fc099800640 1 -- 172.21.15.32:0/2397605830 wait complete. 2024-04-26T23:34:29.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.798+0000 7fc099800640 1 Processor -- start 2024-04-26T23:34:29.801 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.798+0000 7fc099800640 1 -- start start 2024-04-26T23:34:29.803 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.799+0000 7fc099800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0940ba110 0x7fc0941ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.799+0000 7fc099800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940bae50 0x7fc094135820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.799+0000 7fc099800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0941484d0 0x7fc09412fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.799+0000 7fc099800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc094142b70 con 0x7fc0940ba110 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.799+0000 7fc099800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fc0941429f0 con 0x7fc0940bae50 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.799+0000 7fc099800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc094152d10 con 0x7fc0941484d0 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0941484d0 0x7fc09412fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc093400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940bae50 0x7fc094135820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0941484d0 0x7fc09412fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.32:39086/0 (socket says 172.21.15.32:39086) 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 -- 172.21.15.32:0/1254463124 learned_addr learned my addr 172.21.15.32:0/1254463124 (peer_addr_for_me v2:172.21.15.32:0/0) 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc093e00640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0940ba110 0x7fc0941ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 -- 172.21.15.32:0/1254463124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940bae50 msgr2=0x7fc094135820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940bae50 0x7fc094135820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 -- 172.21.15.32:0/1254463124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0940ba110 msgr2=0x7fc0941ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.804 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0940ba110 0x7fc0941ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 -- 172.21.15.32:0/1254463124 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc094130a10 con 0x7fc0941484d0 2024-04-26T23:34:29.805 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.800+0000 7fc098e00640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0941484d0 0x7fc09412fea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007e60 tx=0x7fc08c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.801+0000 7fc08be00640 1 -- 172.21.15.32:0/1254463124 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c014420 con 0x7fc0941484d0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.801+0000 7fc08be00640 1 -- 172.21.15.32:0/1254463124 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08c019070 con 0x7fc0941484d0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.801+0000 7fc08be00640 1 -- 172.21.15.32:0/1254463124 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c014820 con 0x7fc0941484d0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.801+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc094136aa0 con 0x7fc0941484d0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.801+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc094137210 con 0x7fc0941484d0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.801+0000 7fc08be00640 1 -- 172.21.15.32:0/1254463124 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc08c0149c0 con 0x7fc0941484d0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.801+0000 7fc08be00640 1 -- 172.21.15.32:0/1254463124 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc08c014cb0 con 0x7fc0941484d0 2024-04-26T23:34:29.806 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.802+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc094076600 con 0x7fc0941484d0 2024-04-26T23:34:29.808 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.805+0000 7fc08be00640 1 -- 172.21.15.32:0/1254463124 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc08c01e460 con 0x7fc0941484d0 2024-04-26T23:34:29.832 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:29.829+0000 7f61c8b20040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:34:29.888 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.884+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e7fdc82b-772b-4633-bff6-777d58014535", "id": 7} v 0) -- 0x7fc094140cf0 con 0x7fc0941484d0 2024-04-26T23:34:29.894 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.891+0000 7fc08be00640 1 -- 172.21.15.32:0/1254463124 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7fdc82b-772b-4633-bff6-777d58014535", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc08c01e640 con 0x7fc0941484d0 2024-04-26T23:34:29.895 INFO:teuthology.orchestra.run.smithi032.stdout:7 2024-04-26T23:34:29.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0941484d0 msgr2=0x7fc09412fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:29.896 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0941484d0 0x7fc09412fea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007e60 tx=0x7fc08c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 shutdown_connections 2024-04-26T23:34:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0940bae50 0x7fc094135820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0941484d0 0x7fc09412fea0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 --2- 172.21.15.32:0/1254463124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0940ba110 0x7fc0941ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 >> 172.21.15.32:0/1254463124 conn(0x7fc0940684b0 msgr2=0x7fc09413a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 shutdown_connections 2024-04-26T23:34:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2024-04-26T23:34:29.893+0000 7fc099800640 1 -- 172.21.15.32:0/1254463124 wait complete. 2024-04-26T23:34:29.898 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:29.895+0000 7f61c8b20040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:34:29.914 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T23:34:29.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T23:34:29.921 INFO:tasks.ceph.osd.0:Started 2024-04-26T23:34:29.921 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T23:34:29.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T23:34:29.931 INFO:tasks.ceph.osd.1:Started 2024-04-26T23:34:29.931 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T23:34:29.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T23:34:29.936 INFO:tasks.ceph.osd.2:Started 2024-04-26T23:34:29.937 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T23:34:29.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T23:34:29.942 INFO:tasks.ceph.osd.3:Started 2024-04-26T23:34:29.942 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T23:34:29.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T23:34:29.949 INFO:tasks.ceph.osd.4:Started 2024-04-26T23:34:29.949 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T23:34:29.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T23:34:29.955 INFO:tasks.ceph.osd.5:Started 2024-04-26T23:34:29.956 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T23:34:29.956 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T23:34:29.960 INFO:tasks.ceph.osd.6:Started 2024-04-26T23:34:29.960 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T23:34:29.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T23:34:29.964 INFO:tasks.ceph.osd.7:Started 2024-04-26T23:34:29.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:30.057 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:30.053+0000 7f61c8b20040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T23:34:30.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.177+0000 7f828be00640 1 Processor -- start 2024-04-26T23:34:30.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.177+0000 7f828be00640 1 -- start start 2024-04-26T23:34:30.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f828c0bd7a0 0x7f828c148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:30.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828be00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828c0bc010 con 0x7f828c073420 2024-04-26T23:34:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828be00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828c148220 con 0x7f828c0bbc30 2024-04-26T23:34:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828be00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f828c149220 con 0x7f828c0bd7a0 2024-04-26T23:34:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828a000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f828c0bd7a0 0x7f828c148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f828c073420 0x7f828c073cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36846/0 (socket says 172.21.15.16:36846) 2024-04-26T23:34:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828a000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f828c0bd7a0 0x7f828c148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:49616/0 (socket says 172.21.15.16:49616) 2024-04-26T23:34:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828b400640 1 -- 172.21.15.16:0/32631923 learned_addr learned my addr 172.21.15.16:0/32631923 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.178+0000 7f828aa00640 1 --1- 172.21.15.16:0/32631923 >> v1:172.21.15.32:6789/0 conn(0x7f828c0bbc30 0x7f828c0baa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:60994/0 (socket says 172.21.15.16:60994) 2024-04-26T23:34:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.179+0000 7f828a000640 1 -- 172.21.15.16:0/32631923 >> v1:172.21.15.32:6789/0 conn(0x7f828c0bbc30 legacy=0x7f828c0baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.179+0000 7f828a000640 1 -- 172.21.15.16:0/32631923 >> v1:172.21.15.16:6789/0 conn(0x7f828c073420 legacy=0x7f828c073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.179+0000 7f828a000640 1 -- 172.21.15.16:0/32631923 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c1484e0 con 0x7f828c0bd7a0 2024-04-26T23:34:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.179+0000 7f8289600640 1 -- 172.21.15.16:0/32631923 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150075083 0 0) 0x7f828c0bc010 con 0x7f828c073420 2024-04-26T23:34:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.180+0000 7f828a000640 1 --2- 172.21.15.16:0/32631923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bd7a0 0x7f828c148ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f82740097a0 tx=0x7f827402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cc17a1b716a0fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.180+0000 7f8289600640 1 -- 172.21.15.16:0/32631923 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274037070 con 0x7f828c0bd7a0 2024-04-26T23:34:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.180+0000 7f8289600640 1 -- 172.21.15.16:0/32631923 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8274032440 con 0x7f828c0bd7a0 2024-04-26T23:34:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.180+0000 7f8289600640 1 -- 172.21.15.16:0/32631923 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827402ae60 con 0x7f828c0bd7a0 2024-04-26T23:34:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.180+0000 7f828be00640 1 -- 172.21.15.16:0/32631923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bd7a0 msgr2=0x7f828c148ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:30.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.180+0000 7f828be00640 1 --2- 172.21.15.16:0/32631923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bd7a0 0x7f828c148ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f82740097a0 tx=0x7f827402a110 comp rx=0 tx=0).stop 2024-04-26T23:34:30.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.181+0000 7f828be00640 1 -- 172.21.15.16:0/32631923 shutdown_connections 2024-04-26T23:34:30.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.181+0000 7f828be00640 1 --2- 172.21.15.16:0/32631923 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bd7a0 0x7f828c148ce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:30.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.181+0000 7f828be00640 1 -- 172.21.15.16:0/32631923 >> 172.21.15.16:0/32631923 conn(0x7f828c09fc60 msgr2=0x7f828c0a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:30.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.181+0000 7f828be00640 1 -- 172.21.15.16:0/32631923 shutdown_connections 2024-04-26T23:34:30.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.181+0000 7f828be00640 1 -- 172.21.15.16:0/32631923 wait complete. 2024-04-26T23:34:30.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.182+0000 7f828be00640 1 Processor -- start 2024-04-26T23:34:30.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.182+0000 7f828be00640 1 -- start start 2024-04-26T23:34:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828be00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f828c073420 0x7f828c14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bbc30 0x7f828c1e1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f828c0bd7a0 0x7f828c141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f828c074580 con 0x7f828c0bd7a0 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828be00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f828c074400 con 0x7f828c0bbc30 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828be00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f828c153bb0 con 0x7f828c073420 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f828c0bd7a0 0x7f828c141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bbc30 0x7f828c1e1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828a000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bbc30 0x7f828c1e1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:49632/0 (socket says 172.21.15.16:49632) 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828a000640 1 -- 172.21.15.16:0/3012108141 learned_addr learned my addr 172.21.15.16:0/3012108141 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.183+0000 7f828aa00640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f828c073420 0x7f828c14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828b400640 1 -- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f828c073420 msgr2=0x7f828c14bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828b400640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f828c073420 0x7f828c14bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828b400640 1 -- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bbc30 msgr2=0x7f828c1e1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828b400640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bbc30 0x7f828c1e1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828b400640 1 -- 172.21.15.16:0/3012108141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c0a3610 con 0x7f828c0bd7a0 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828a000640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bbc30 0x7f828c1e1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828b400640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f828c0bd7a0 0x7f828c141da0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f828c073890 tx=0x7f828400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f8283400640 1 -- 172.21.15.16:0/3012108141 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284017070 con 0x7f828c0bd7a0 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f8283400640 1 -- 172.21.15.16:0/3012108141 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8284005d00 con 0x7f828c0bd7a0 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f8283400640 1 -- 172.21.15.16:0/3012108141 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284007310 con 0x7f828c0bd7a0 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.184+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828c0a1ad0 con 0x7f828c0bd7a0 2024-04-26T23:34:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.185+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828c0b3ff0 con 0x7f828c0bd7a0 2024-04-26T23:34:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.185+0000 7f8283400640 1 -- 172.21.15.16:0/3012108141 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f828401a070 con 0x7f828c0bd7a0 2024-04-26T23:34:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.185+0000 7f8283400640 1 -- 172.21.15.16:0/3012108141 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8284012ad0 con 0x7f828c0bd7a0 2024-04-26T23:34:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.186+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f828c076600 con 0x7f828c0bd7a0 2024-04-26T23:34:30.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.190+0000 7f8283400640 1 -- 172.21.15.16:0/3012108141 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8284021020 con 0x7f828c0bd7a0 2024-04-26T23:34:30.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.257+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f828c0b7f80 con 0x7f828c0bd7a0 2024-04-26T23:34:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.258+0000 7f8283400640 1 -- 172.21.15.16:0/3012108141 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f82840074b0 con 0x7f828c0bd7a0 2024-04-26T23:34:30.261 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:30.261 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:29.887762+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:30.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f828c0bd7a0 msgr2=0x7f828c141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:30.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f828c0bd7a0 0x7f828c141da0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f828c073890 tx=0x7f828400c870 comp rx=0 tx=0).stop 2024-04-26T23:34:30.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 shutdown_connections 2024-04-26T23:34:30.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f828c0bbc30 0x7f828c1e1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:30.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f828c0bd7a0 0x7f828c141da0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:30.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 --2- 172.21.15.16:0/3012108141 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f828c073420 0x7f828c14bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:30.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 >> 172.21.15.16:0/3012108141 conn(0x7f828c09fc60 msgr2=0x7f828c147a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:30.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 shutdown_connections 2024-04-26T23:34:30.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:30.259+0000 7f828be00640 1 -- 172.21.15.16:0/3012108141 wait complete. 2024-04-26T23:34:30.273 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:30.270+0000 7f285ec1e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T23:34:30.278 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T23:34:30.279 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T23:34:30.437 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:30.434+0000 7f61c8b20040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:34:30.497 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:30.493+0000 7f61c8b20040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:34:30.584 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:30.580+0000 7f285ec1e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:34:30.629 INFO:tasks.ceph.osd.5.smithi032.stderr:2024-04-26T23:34:30.625+0000 7fba13a14640 -1 Falling back to public interface 2024-04-26T23:34:30.635 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T23:34:30.632+0000 7eff1680f640 -1 Falling back to public interface 2024-04-26T23:34:30.635 INFO:tasks.ceph.osd.7.smithi032.stderr:2024-04-26T23:34:30.632+0000 7fad84419640 -1 Falling back to public interface 2024-04-26T23:34:30.641 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T23:34:30.638+0000 7fe2bfa13640 -1 Falling back to public interface 2024-04-26T23:34:30.647 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:30.644+0000 7f285ec1e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:34:30.660 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T23:34:30.657+0000 7f7bb2c0c640 -1 Falling back to public interface 2024-04-26T23:34:30.669 INFO:tasks.ceph.osd.6.smithi032.stderr:2024-04-26T23:34:30.666+0000 7f420f733640 -1 Falling back to public interface 2024-04-26T23:34:30.675 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T23:34:30.672+0000 7f713c420640 -1 Falling back to public interface 2024-04-26T23:34:30.678 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-04-26T23:34:30.675+0000 7fad3d431640 -1 Falling back to public interface 2024-04-26T23:34:30.693 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:30.689+0000 7f61c8b20040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:34:30.789 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:30.786+0000 7f285ec1e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T23:34:30.868 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:30.865+0000 7f61c8b20040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:34:30.930 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:30.927+0000 7f61c8b20040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:34:31.017 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:31.013+0000 7f61c8b20040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:34:31.073 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:31.070+0000 7f61c8b20040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:34:31.084 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:31.139 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:31.136+0000 7f285ec1e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:34:31.198 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:31.195+0000 7f285ec1e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:34:31.242 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.239+0000 7f06f3600640 1 Processor -- start 2024-04-26T23:34:31.242 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.239+0000 7f06f3600640 1 -- start start 2024-04-26T23:34:31.244 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06f3600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06ec0baef0 0x7f06ec0b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:31.244 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06f3600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec0b4a10 0x7f06ec0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:31.244 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06f3600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec0b8160 con 0x7f06ec0b6090 2024-04-26T23:34:31.244 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06f3600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f06ec142d10 con 0x7f06ec0baef0 2024-04-26T23:34:31.244 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06f3600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec0b6a20 con 0x7f06ec0b4a10 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06ebe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec0b4a10 0x7f06ec0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06f0c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06ec0baef0 0x7f06ec0b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06ebe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec0b4a10 0x7f06ec0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:50350/0 (socket says 172.21.15.16:50350) 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06ebe00640 1 -- 172.21.15.16:0/19167181 learned_addr learned my addr 172.21.15.16:0/19167181 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.240+0000 7f06f0c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06ec0baef0 0x7f06ec0b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:49648/0 (socket says 172.21.15.16:49648) 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.241+0000 7f06f0c00640 1 -- 172.21.15.16:0/19167181 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec0b4a10 msgr2=0x7f06ec0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.241+0000 7f06f0c00640 1 --2- 172.21.15.16:0/19167181 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec0b4a10 0x7f06ec0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.241+0000 7f06f0c00640 1 -- 172.21.15.16:0/19167181 >> v1:172.21.15.32:6789/0 conn(0x7f06ec0b6090 legacy=0x7f06ec14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:31.245 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.241+0000 7f06f0c00640 1 -- 172.21.15.16:0/19167181 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec0bb2d0 con 0x7f06ec0baef0 2024-04-26T23:34:31.246 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.242+0000 7f06f0c00640 1 --2- 172.21.15.16:0/19167181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec0b55a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06ec142e90 tx=0x7f06e002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8f95fb654369f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:31.246 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.242+0000 7f06eb400640 1 -- 172.21.15.16:0/19167181 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0037070 con 0x7f06ec0baef0 2024-04-26T23:34:31.246 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.242+0000 7f06eb400640 1 -- 172.21.15.16:0/19167181 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e002ae50 con 0x7f06ec0baef0 2024-04-26T23:34:31.246 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.242+0000 7f06eb400640 1 -- 172.21.15.16:0/19167181 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0032660 con 0x7f06ec0baef0 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 -- 172.21.15.16:0/19167181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 msgr2=0x7f06ec0b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 --2- 172.21.15.16:0/19167181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec0b55a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06ec142e90 tx=0x7f06e002a100 comp rx=0 tx=0).stop 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 -- 172.21.15.16:0/19167181 shutdown_connections 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 --2- 172.21.15.16:0/19167181 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec0b4a10 0x7f06ec0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 --2- 172.21.15.16:0/19167181 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec0b55a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 -- 172.21.15.16:0/19167181 >> 172.21.15.16:0/19167181 conn(0x7f06ec075680 msgr2=0x7f06ec075a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 -- 172.21.15.16:0/19167181 shutdown_connections 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.243+0000 7f06f3600640 1 -- 172.21.15.16:0/19167181 wait complete. 2024-04-26T23:34:31.247 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.244+0000 7f06f3600640 1 Processor -- start 2024-04-26T23:34:31.248 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.245+0000 7f06f3600640 1 -- start start 2024-04-26T23:34:31.249 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.245+0000 7f06f3600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec1d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:31.249 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.245+0000 7f06f3600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06ec1d2fc0 0x7f06ec1d41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.245+0000 7f06f3600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec1d4700 0x7f06ec1e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.245+0000 7f06f3600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec148550 con 0x7f06ec1d2fc0 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.245+0000 7f06f3600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec0ba1a0 con 0x7f06ec0baef0 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.245+0000 7f06f3600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec1486d0 con 0x7f06ec1d4700 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06ebe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06ec1d2fc0 0x7f06ec1d41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06ebe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06ec1d2fc0 0x7f06ec1d41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47944/0 (socket says 172.21.15.16:47944) 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06ebe00640 1 -- 172.21.15.16:0/3047327189 learned_addr learned my addr 172.21.15.16:0/3047327189 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f0c00640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec1d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f1600640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec1d4700 0x7f06ec1e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f0c00640 1 -- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec1d4700 msgr2=0x7f06ec1e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f0c00640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec1d4700 0x7f06ec1e1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f0c00640 1 -- 172.21.15.16:0/3047327189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06ec1d2fc0 msgr2=0x7f06ec1d41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:31.250 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f0c00640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06ec1d2fc0 0x7f06ec1d41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.251 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f0c00640 1 -- 172.21.15.16:0/3047327189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec1d4b90 con 0x7f06ec0baef0 2024-04-26T23:34:31.251 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.246+0000 7f06f0c00640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec1d0e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0b8330 tx=0x7f06e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:31.251 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.247+0000 7f06e8c00640 1 -- 172.21.15.16:0/3047327189 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0041030 con 0x7f06ec0baef0 2024-04-26T23:34:31.252 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.247+0000 7f06e8c00640 1 -- 172.21.15.16:0/3047327189 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e002ac50 con 0x7f06ec0baef0 2024-04-26T23:34:31.252 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.247+0000 7f06e8c00640 1 -- 172.21.15.16:0/3047327189 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0037040 con 0x7f06ec0baef0 2024-04-26T23:34:31.252 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.247+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec0b4730 con 0x7f06ec0baef0 2024-04-26T23:34:31.252 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.247+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec1d3780 con 0x7f06ec0baef0 2024-04-26T23:34:31.252 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.247+0000 7f06e8c00640 1 -- 172.21.15.16:0/3047327189 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f06e0044070 con 0x7f06ec0baef0 2024-04-26T23:34:31.252 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.247+0000 7f06e8c00640 1 -- 172.21.15.16:0/3047327189 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f06e0046780 con 0x7f06ec0baef0 2024-04-26T23:34:31.252 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.248+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec0765c0 con 0x7f06ec0baef0 2024-04-26T23:34:31.254 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.251+0000 7f06e8c00640 1 -- 172.21.15.16:0/3047327189 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f06e002ae20 con 0x7f06ec0baef0 2024-04-26T23:34:31.322 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.319+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06ec0b5b90 con 0x7f06ec0baef0 2024-04-26T23:34:31.324 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.321+0000 7f06e8c00640 1 -- 172.21.15.16:0/3047327189 <== mon.1 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f06e0032e20 con 0x7f06ec0baef0 2024-04-26T23:34:31.324 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T23:34:31.324 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:29.887762+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 msgr2=0x7f06ec1d0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec1d0e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0b8330 tx=0x7f06e00046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 shutdown_connections 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f06ec1d4700 0x7f06ec1e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06ec1d2fc0 0x7f06ec1d41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 --2- 172.21.15.16:0/3047327189 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06ec0baef0 0x7f06ec1d0e40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 >> 172.21.15.16:0/3047327189 conn(0x7f06ec075680 msgr2=0x7f06ec075a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 shutdown_connections 2024-04-26T23:34:31.326 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:31.322+0000 7f06f3600640 1 -- 172.21.15.16:0/3047327189 wait complete. 2024-04-26T23:34:31.339 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:34:31.392 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:31.389+0000 7f285ec1e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:34:31.568 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:31.565+0000 7f285ec1e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:34:31.629 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:31.626+0000 7f285ec1e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:34:31.646 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:31.643+0000 7f61c8b20040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:34:31.713 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:31.710+0000 7f285ec1e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:34:31.769 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:31.766+0000 7f285ec1e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:34:31.786 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:31.781+0000 7f61c8b20040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:34:32.340 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:32.336+0000 7f285ec1e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:34:32.477 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T23:34:32.474+0000 7f285ec1e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:34:32.834 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:32.830+0000 7f6168800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T23:34:32.834 INFO:tasks.ceph.mgr.x.smithi032.stderr:2024-04-26T23:34:32.830+0000 7f6168800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T23:34:34.270 INFO:tasks.ceph.osd.7.smithi032.stderr:2024-04-26T23:34:34.267+0000 7fad84419640 -1 osd.7 0 log_to_monitors true 2024-04-26T23:34:34.288 INFO:tasks.ceph.osd.5.smithi032.stderr:2024-04-26T23:34:34.285+0000 7fba13a14640 -1 osd.5 0 log_to_monitors true 2024-04-26T23:34:34.297 INFO:tasks.ceph.osd.6.smithi032.stderr:2024-04-26T23:34:34.294+0000 7f420f733640 -1 osd.6 0 log_to_monitors true 2024-04-26T23:34:34.307 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-04-26T23:34:34.304+0000 7fad3d431640 -1 osd.4 0 log_to_monitors true 2024-04-26T23:34:34.321 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T23:34:34.318+0000 7eff1680f640 -1 osd.1 0 log_to_monitors true 2024-04-26T23:34:34.342 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T23:34:34.339+0000 7f7bb2c0c640 -1 osd.2 0 log_to_monitors true 2024-04-26T23:34:34.396 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T23:34:34.393+0000 7f713c420640 -1 osd.3 0 log_to_monitors true 2024-04-26T23:34:34.481 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T23:34:34.478+0000 7fe2bfa13640 -1 osd.0 0 log_to_monitors true 2024-04-26T23:34:37.543 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T23:34:37.540+0000 7eff11200640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T23:34:37.548 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T23:34:37.545+0000 7eff07200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:37.554 INFO:tasks.ceph.osd.5.smithi032.stderr:2024-04-26T23:34:37.551+0000 7fba0ee00640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T23:34:37.556 INFO:tasks.ceph.osd.7.smithi032.stderr:2024-04-26T23:34:37.552+0000 7fad7f200640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T23:34:37.566 INFO:tasks.ceph.osd.5.smithi032.stderr:2024-04-26T23:34:37.560+0000 7fba04400640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:37.567 INFO:tasks.ceph.osd.7.smithi032.stderr:2024-04-26T23:34:37.562+0000 7fad75200640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:37.574 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-04-26T23:34:37.571+0000 7fad37800640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T23:34:37.581 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T23:34:37.578+0000 7fe2ba200640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T23:34:37.586 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T23:34:37.583+0000 7fe2b0200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:37.587 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T23:34:37.584+0000 7f7bad400640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T23:34:37.591 INFO:tasks.ceph.osd.4.smithi032.stderr:2024-04-26T23:34:37.587+0000 7fad2d800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:37.602 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T23:34:37.599+0000 7f7ba3400640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:37.609 INFO:tasks.ceph.osd.6.smithi032.stderr:2024-04-26T23:34:37.606+0000 7f420a600640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T23:34:37.616 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T23:34:37.613+0000 7f7136c00640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T23:34:37.617 INFO:tasks.ceph.osd.6.smithi032.stderr:2024-04-26T23:34:37.614+0000 7f4200600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:37.628 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T23:34:37.625+0000 7f712cc00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:34:38.144 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:38.340 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.336+0000 7ff3cb200640 1 Processor -- start 2024-04-26T23:34:38.340 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.336+0000 7ff3cb200640 1 -- start start 2024-04-26T23:34:38.341 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.338+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc145170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.341 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.338+0000 7ff3cb200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3cc1456b0 0x7ff3cc13ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.341 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.338+0000 7ff3cb200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3cc070250 con 0x7ff3cc13f350 2024-04-26T23:34:38.341 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.338+0000 7ff3cb200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7ff3cc0704c0 con 0x7ff3cc1456b0 2024-04-26T23:34:38.341 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.338+0000 7ff3cb200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc145b10 con 0x7ff3cc06e0f0 2024-04-26T23:34:38.342 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3cc1456b0 0x7ff3cc13ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.342 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c9e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.342 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c1400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3cc1456b0 0x7ff3cc13ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:46238/0 (socket says 172.21.15.16:46238) 2024-04-26T23:34:38.342 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c1400640 1 -- 172.21.15.16:0/2694072052 learned_addr learned my addr 172.21.15.16:0/2694072052 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:38.342 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c1400640 1 -- 172.21.15.16:0/2694072052 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 msgr2=0x7ff3cc145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:38.343 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c1400640 1 --2- 172.21.15.16:0/2694072052 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.343 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c1400640 1 -- 172.21.15.16:0/2694072052 >> v1:172.21.15.32:6789/0 conn(0x7ff3cc13f350 legacy=0x7ff3cc1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:38.343 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.339+0000 7ff3c1400640 1 -- 172.21.15.16:0/2694072052 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc06e4d0 con 0x7ff3cc1456b0 2024-04-26T23:34:38.343 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.341+0000 7ff3c1400640 1 --2- 172.21.15.16:0/2694072052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13ee10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400bb10 tx=0x7ff3b402c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=609a106fc2f37a10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:38.344 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.341+0000 7ff3c9400640 1 -- 172.21.15.16:0/2694072052 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4031710 con 0x7ff3cc1456b0 2024-04-26T23:34:38.344 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.341+0000 7ff3c9400640 1 -- 172.21.15.16:0/2694072052 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40318b0 con 0x7ff3cc1456b0 2024-04-26T23:34:38.344 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.341+0000 7ff3c9400640 1 -- 172.21.15.16:0/2694072052 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4031c80 con 0x7ff3cc1456b0 2024-04-26T23:34:38.345 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 -- 172.21.15.16:0/2694072052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc1456b0 msgr2=0x7ff3cc13ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.345 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 --2- 172.21.15.16:0/2694072052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13ee10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400bb10 tx=0x7ff3b402c7a0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.345 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 -- 172.21.15.16:0/2694072052 shutdown_connections 2024-04-26T23:34:38.346 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 --2- 172.21.15.16:0/2694072052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13ee10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.346 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 --2- 172.21.15.16:0/2694072052 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.346 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 -- 172.21.15.16:0/2694072052 >> 172.21.15.16:0/2694072052 conn(0x7ff3cc0b61e0 msgr2=0x7ff3cc0b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:38.346 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 -- 172.21.15.16:0/2694072052 shutdown_connections 2024-04-26T23:34:38.346 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.342+0000 7ff3cb200640 1 -- 172.21.15.16:0/2694072052 wait complete. 2024-04-26T23:34:38.347 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.344+0000 7ff3cb200640 1 Processor -- start 2024-04-26T23:34:38.348 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.345+0000 7ff3cb200640 1 -- start start 2024-04-26T23:34:38.349 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.349 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc13f350 0x7ff3cc1dd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.349 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3cb200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.349 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3cb200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b2a70 con 0x7ff3cc1456b0 2024-04-26T23:34:38.349 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3cb200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b2790 con 0x7ff3cc13f350 2024-04-26T23:34:38.349 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3cb200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc0b2d50 con 0x7ff3cc06e0f0 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3ca800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3ca800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50086/0 (socket says 172.21.15.16:50086) 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3ca800640 1 -- 172.21.15.16:0/3438719061 learned_addr learned my addr 172.21.15.16:0/3438719061 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.346+0000 7ff3c1400640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc13f350 0x7ff3cc1dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3c9e00640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3ca800640 1 -- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 msgr2=0x7ff3cc141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3ca800640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.351 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3ca800640 1 -- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc13f350 msgr2=0x7ff3cc1dd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3ca800640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc13f350 0x7ff3cc1dd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3ca800640 1 -- 172.21.15.16:0/3438719061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc1cbe10 con 0x7ff3cc1456b0 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3c9e00640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3ca800640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13b920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c780 tx=0x7ff3c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.347+0000 7ff3c2a00640 1 -- 172.21.15.16:0/3438719061 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4004b60 con 0x7ff3cc1456b0 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.348+0000 7ff3c2a00640 1 -- 172.21.15.16:0/3438719061 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c4004d00 con 0x7ff3cc1456b0 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.348+0000 7ff3c2a00640 1 -- 172.21.15.16:0/3438719061 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400aa90 con 0x7ff3cc1456b0 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.348+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc1cc0f0 con 0x7ff3cc1456b0 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.348+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc072240 con 0x7ff3cc1456b0 2024-04-26T23:34:38.352 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.349+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc0506c0 con 0x7ff3cc1456b0 2024-04-26T23:34:38.353 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.350+0000 7ff3c2a00640 1 -- 172.21.15.16:0/3438719061 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff3c400ac30 con 0x7ff3cc1456b0 2024-04-26T23:34:38.354 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.351+0000 7ff3c2a00640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff3a806c860 0x7ff3a806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.354 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.351+0000 7ff3c2a00640 1 -- 172.21.15.16:0/3438719061 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7ff3c408af40 con 0x7ff3cc1456b0 2024-04-26T23:34:38.354 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.351+0000 7ff3c9e00640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff3a806c860 0x7ff3a806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.356 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.353+0000 7ff3c9e00640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff3a806c860 0x7ff3a806ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc073040 tx=0x7ff3bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:38.359 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.356+0000 7ff3c2a00640 1 -- 172.21.15.16:0/3438719061 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff3c4020070 con 0x7ff3cc1456b0 2024-04-26T23:34:38.567 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.563+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3cc0b38a0 con 0x7ff3cc1456b0 2024-04-26T23:34:38.568 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.565+0000 7ff3c2a00640 1 -- 172.21.15.16:0/3438719061 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10861 (secure 0 0 0) 0x7ff3c405a1d0 con 0x7ff3cc1456b0 2024-04-26T23:34:38.568 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T23:34:38.568 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":13,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:38.534416+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:38.571 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.567+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff3a806c860 msgr2=0x7ff3a806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.571 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.567+0000 7ff3cb200640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff3a806c860 0x7ff3a806ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc073040 tx=0x7ff3bc008040 comp rx=0 tx=0).stop 2024-04-26T23:34:38.571 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.567+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3cc1456b0 msgr2=0x7ff3cc13b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.571 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.567+0000 7ff3cb200640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13b920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c780 tx=0x7ff3c400cc40 comp rx=0 tx=0).stop 2024-04-26T23:34:38.571 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 shutdown_connections 2024-04-26T23:34:38.571 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff3a806c860 0x7ff3a806ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.572 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3cc13f350 0x7ff3cc1dd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.572 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3cc1456b0 0x7ff3cc13b920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.572 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 --2- 172.21.15.16:0/3438719061 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff3cc06e0f0 0x7ff3cc141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.572 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 >> 172.21.15.16:0/3438719061 conn(0x7ff3cc0b61e0 msgr2=0x7ff3cc0b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:38.572 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 shutdown_connections 2024-04-26T23:34:38.572 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T23:34:38.568+0000 7ff3cb200640 1 -- 172.21.15.16:0/3438719061 wait complete. 2024-04-26T23:34:38.585 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T23:34:38.585 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T23:34:38.585 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:34:38.585 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:34:38.589 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:34:38.590 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:34:38.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:34:38.597 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:34:38.597 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T23:34:38.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:38.735 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T23:34:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.758+0000 7ff307600640 1 Processor -- start 2024-04-26T23:34:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.758+0000 7ff307600640 1 -- start start 2024-04-26T23:34:38.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff307600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3000be6e0 0x7ff30014bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff307600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff30014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff307600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3000beac0 con 0x7ff3000ba3f0 2024-04-26T23:34:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff307600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff3000b57c0 con 0x7ff3000be6e0 2024-04-26T23:34:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff307600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff3000b5aa0 con 0x7ff300142880 2024-04-26T23:34:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff2ffe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff3000ba3f0 0x7ff300142170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55150/0 (socket says 172.21.15.16:55150) 2024-04-26T23:34:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff304c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3000be6e0 0x7ff30014bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff2ffe00640 1 -- 172.21.15.16:0/550942205 learned_addr learned my addr 172.21.15.16:0/550942205 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.759+0000 7ff305600640 1 --2- 172.21.15.16:0/550942205 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff30014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.764 INFO:tasks.ceph.mds.b.smithi032.stdout:starting mds.b at 2024-04-26T23:34:38.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.760+0000 7ff2ff400640 1 -- 172.21.15.16:0/550942205 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157846311 0 0) 0x7ff3000beac0 con 0x7ff3000ba3f0 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.760+0000 7ff2ff400640 1 -- 172.21.15.16:0/550942205 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2e8003520 con 0x7ff3000ba3f0 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.760+0000 7ff304c00640 1 -- 172.21.15.16:0/550942205 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 msgr2=0x7ff30014c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.760+0000 7ff304c00640 1 --2- 172.21.15.16:0/550942205 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff30014c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.760+0000 7ff304c00640 1 -- 172.21.15.16:0/550942205 >> v1:172.21.15.16:6789/0 conn(0x7ff3000ba3f0 legacy=0x7ff300142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.760+0000 7ff304c00640 1 -- 172.21.15.16:0/550942205 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3000b5d80 con 0x7ff3000be6e0 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.761+0000 7ff304c00640 1 --2- 172.21.15.16:0/550942205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30014bb60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097a0 tx=0x7ff2f402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06d5ca5f60982bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.761+0000 7ff2ff400640 1 -- 172.21.15.16:0/550942205 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4037070 con 0x7ff3000be6e0 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.761+0000 7ff2ff400640 1 -- 172.21.15.16:0/550942205 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f402ae50 con 0x7ff3000be6e0 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.761+0000 7ff2ff400640 1 -- 172.21.15.16:0/550942205 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4032660 con 0x7ff3000be6e0 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.761+0000 7ff307600640 1 -- 172.21.15.16:0/550942205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 msgr2=0x7ff30014bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.761+0000 7ff307600640 1 --2- 172.21.15.16:0/550942205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30014bb60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097a0 tx=0x7ff2f402a100 comp rx=0 tx=0).stop 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.762+0000 7ff307600640 1 -- 172.21.15.16:0/550942205 shutdown_connections 2024-04-26T23:34:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.762+0000 7ff307600640 1 --2- 172.21.15.16:0/550942205 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff30014c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.762+0000 7ff307600640 1 --2- 172.21.15.16:0/550942205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30014bb60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.762+0000 7ff307600640 1 -- 172.21.15.16:0/550942205 >> 172.21.15.16:0/550942205 conn(0x7ff3000686c0 msgr2=0x7ff3000bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:38.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.762+0000 7ff307600640 1 -- 172.21.15.16:0/550942205 shutdown_connections 2024-04-26T23:34:38.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.762+0000 7ff307600640 1 -- 172.21.15.16:0/550942205 wait complete. 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.763+0000 7ff307600640 1 Processor -- start 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.763+0000 7ff307600640 1 -- start start 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff307600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff307600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff3001e1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff307600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3001e1e90 0x7ff3001403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff307600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3000b6d80 con 0x7ff3000be6e0 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff307600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ff3000b6c00 con 0x7ff3001e1e90 2024-04-26T23:34:38.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff307600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff300152df0 con 0x7ff300142880 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff304c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff304c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30013fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50114/0 (socket says 172.21.15.16:50114) 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.764+0000 7ff304c00640 1 -- 172.21.15.16:0/4249886742 learned_addr learned my addr 172.21.15.16:0/4249886742 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff305600640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3001e1e90 0x7ff3001403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff2ffe00640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff3001e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff304c00640 1 -- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 msgr2=0x7ff3001e1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff304c00640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff3001e1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff304c00640 1 -- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3001e1e90 msgr2=0x7ff3001403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff304c00640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3001e1e90 0x7ff3001403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff304c00640 1 -- 172.21.15.16:0/4249886742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff300139430 con 0x7ff3000be6e0 2024-04-26T23:34:38.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff304c00640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30013fc00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4035040 tx=0x7ff2f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:38.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.765+0000 7ff2fcc00640 1 -- 172.21.15.16:0/4249886742 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4041070 con 0x7ff3000be6e0 2024-04-26T23:34:38.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.766+0000 7ff2fcc00640 1 -- 172.21.15.16:0/4249886742 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f403c460 con 0x7ff3000be6e0 2024-04-26T23:34:38.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.766+0000 7ff2fcc00640 1 -- 172.21.15.16:0/4249886742 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4037040 con 0x7ff3000be6e0 2024-04-26T23:34:38.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.766+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff300141010 con 0x7ff3000be6e0 2024-04-26T23:34:38.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.766+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3001408e0 con 0x7ff3000be6e0 2024-04-26T23:34:38.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.767+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300149910 con 0x7ff3000be6e0 2024-04-26T23:34:38.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.768+0000 7ff2fcc00640 1 -- 172.21.15.16:0/4249886742 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff2f403a070 con 0x7ff3000be6e0 2024-04-26T23:34:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.768+0000 7ff2fcc00640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff2e006c890 0x7ff2e006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.769+0000 7ff2fcc00640 1 -- 172.21.15.16:0/4249886742 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7ff2f40ab6d0 con 0x7ff3000be6e0 2024-04-26T23:34:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.769+0000 7ff2ffe00640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff2e006c890 0x7ff2e006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:38.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.770+0000 7ff2ffe00640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff2e006c890 0x7ff2e006ed50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3001463b0 tx=0x7ff2ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:38.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.773+0000 7ff2fcc00640 1 -- 172.21.15.16:0/4249886742 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff300149910 con 0x7ff3000be6e0 2024-04-26T23:34:38.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.975+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3000693a0 con 0x7ff3000be6e0 2024-04-26T23:34:38.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.976+0000 7ff2fcc00640 1 -- 172.21.15.16:0/4249886742 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10861 (secure 0 0 0) 0x7ff2f4079a50 con 0x7ff3000be6e0 2024-04-26T23:34:38.980 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:38.980 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:38.534416+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:38.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff2e006c890 msgr2=0x7ff2e006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff2e006c890 0x7ff2e006ed50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3001463b0 tx=0x7ff2ec009040 comp rx=0 tx=0).stop 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 msgr2=0x7ff30013fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30013fc00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4035040 tx=0x7ff2f40046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 shutdown_connections 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff2e006c890 0x7ff2e006ed50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3001e1e90 0x7ff3001403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff300142880 0x7ff3001e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 --2- 172.21.15.16:0/4249886742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3000be6e0 0x7ff30013fc00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 >> 172.21.15.16:0/4249886742 conn(0x7ff3000686c0 msgr2=0x7ff300146a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 shutdown_connections 2024-04-26T23:34:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:38.979+0000 7ff307600640 1 -- 172.21.15.16:0/4249886742 wait complete. 2024-04-26T23:34:38.999 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-26T23:34:39.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:34:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.204+0000 7fc1ae200640 1 Processor -- start 2024-04-26T23:34:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.205+0000 7fc1ae200640 1 -- start start 2024-04-26T23:34:39.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.206+0000 7fc1ae200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a8150050 0x7fc1a80af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:39.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.206+0000 7fc1ae200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a80af9c0 con 0x7fc1a806e0c0 2024-04-26T23:34:39.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.206+0000 7fc1ae200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a80afca0 con 0x7fc1a806e4a0 2024-04-26T23:34:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.206+0000 7fc1ae200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a80b5a40 con 0x7fc1a8150050 2024-04-26T23:34:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.206+0000 7fc1a7400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc1a806e0c0 0x7fc1a80b5ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55152/0 (socket says 172.21.15.16:55152) 2024-04-26T23:34:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.206+0000 7fc1a7400640 1 -- 172.21.15.16:0/4071821772 learned_addr learned my addr 172.21.15.16:0/4071821772 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.207+0000 7fc1a6a00640 1 --2- 172.21.15.16:0/4071821772 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a8150050 0x7fc1a80af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.207+0000 7fc1a6000640 1 -- 172.21.15.16:0/4071821772 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064244722 0 0) 0x7fc1a80af9c0 con 0x7fc1a806e0c0 2024-04-26T23:34:39.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.207+0000 7fc1a6000640 1 -- 172.21.15.16:0/4071821772 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc18c003520 con 0x7fc1a806e0c0 2024-04-26T23:34:39.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.207+0000 7fc1a6a00640 1 -- 172.21.15.16:0/4071821772 >> v1:172.21.15.32:6789/0 conn(0x7fc1a806e4a0 legacy=0x7fc1a80b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:39.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.207+0000 7fc1a6a00640 1 -- 172.21.15.16:0/4071821772 >> v1:172.21.15.16:6789/0 conn(0x7fc1a806e0c0 legacy=0x7fc1a80b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:39.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.207+0000 7fc1a6a00640 1 -- 172.21.15.16:0/4071821772 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a8073e50 con 0x7fc1a8150050 2024-04-26T23:34:39.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.209+0000 7fc1a6a00640 1 --2- 172.21.15.16:0/4071821772 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a8150050 0x7fc1a80af2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097d0 tx=0x7fc19402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d4c5cdd0bb0699 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:39.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.209+0000 7fc1a6000640 1 -- 172.21.15.16:0/4071821772 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194037070 con 0x7fc1a8150050 2024-04-26T23:34:39.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.209+0000 7fc1a6000640 1 -- 172.21.15.16:0/4071821772 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc194032440 con 0x7fc1a8150050 2024-04-26T23:34:39.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.209+0000 7fc1a6000640 1 -- 172.21.15.16:0/4071821772 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194032810 con 0x7fc1a8150050 2024-04-26T23:34:39.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.210+0000 7fc1ae200640 1 -- 172.21.15.16:0/4071821772 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a8150050 msgr2=0x7fc1a80af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.210+0000 7fc1ae200640 1 --2- 172.21.15.16:0/4071821772 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a8150050 0x7fc1a80af2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097d0 tx=0x7fc19402a180 comp rx=0 tx=0).stop 2024-04-26T23:34:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.210+0000 7fc1ae200640 1 -- 172.21.15.16:0/4071821772 shutdown_connections 2024-04-26T23:34:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.210+0000 7fc1ae200640 1 --2- 172.21.15.16:0/4071821772 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a8150050 0x7fc1a80af2a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.210+0000 7fc1ae200640 1 -- 172.21.15.16:0/4071821772 >> 172.21.15.16:0/4071821772 conn(0x7fc1a80b6630 msgr2=0x7fc1a80b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.210+0000 7fc1ae200640 1 -- 172.21.15.16:0/4071821772 shutdown_connections 2024-04-26T23:34:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.210+0000 7fc1ae200640 1 -- 172.21.15.16:0/4071821772 wait complete. 2024-04-26T23:34:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.212+0000 7fc1ae200640 1 Processor -- start 2024-04-26T23:34:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.212+0000 7fc1ae200640 1 -- start start 2024-04-26T23:34:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.213+0000 7fc1ae200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a806e0c0 0x7fc1a814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.213+0000 7fc1ae200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a806e4a0 0x7fc1a81409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.213+0000 7fc1ae200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a8150050 0x7fc1a8141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.213+0000 7fc1ae200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80b3e80 con 0x7fc1a806e0c0 2024-04-26T23:34:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.213+0000 7fc1ae200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80b3d00 con 0x7fc1a8150050 2024-04-26T23:34:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.213+0000 7fc1ae200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a80b4000 con 0x7fc1a806e4a0 2024-04-26T23:34:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a806e0c0 0x7fc1a814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a806e0c0 0x7fc1a814d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50122/0 (socket says 172.21.15.16:50122) 2024-04-26T23:34:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 -- 172.21.15.16:0/1901698258 learned_addr learned my addr 172.21.15.16:0/1901698258 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a6a00640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a806e4a0 0x7fc1a81409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:39.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7e00640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a8150050 0x7fc1a8141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:39.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 -- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a806e4a0 msgr2=0x7fc1a81409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:39.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a806e4a0 0x7fc1a81409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:39.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 -- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a8150050 msgr2=0x7fc1a8141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:39.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a8150050 0x7fc1a8141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a7400640 1 -- 172.21.15.16:0/1901698258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a8141170 con 0x7fc1a806e0c0 2024-04-26T23:34:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.214+0000 7fc1a6a00640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a806e4a0 0x7fc1a81409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.215+0000 7fc1a7400640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a806e0c0 0x7fc1a814d230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc19800c390 tx=0x7fc19800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.215+0000 7fc19f400640 1 -- 172.21.15.16:0/1901698258 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198017070 con 0x7fc1a806e0c0 2024-04-26T23:34:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.215+0000 7fc19f400640 1 -- 172.21.15.16:0/1901698258 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc198005ce0 con 0x7fc1a806e0c0 2024-04-26T23:34:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.215+0000 7fc19f400640 1 -- 172.21.15.16:0/1901698258 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1980072f0 con 0x7fc1a806e0c0 2024-04-26T23:34:39.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.215+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a8141450 con 0x7fc1a806e0c0 2024-04-26T23:34:39.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.215+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a80728b0 con 0x7fc1a806e0c0 2024-04-26T23:34:39.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.216+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a80693a0 con 0x7fc1a806e0c0 2024-04-26T23:34:39.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.217+0000 7fc19f400640 1 -- 172.21.15.16:0/1901698258 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fc19801a070 con 0x7fc1a806e0c0 2024-04-26T23:34:39.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.218+0000 7fc19f400640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc18806c860 0x7fc18806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:39.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.218+0000 7fc19f400640 1 -- 172.21.15.16:0/1901698258 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fc19808a920 con 0x7fc1a806e0c0 2024-04-26T23:34:39.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.219+0000 7fc1a6a00640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc18806c860 0x7fc18806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:39.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.220+0000 7fc1a6a00640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc18806c860 0x7fc18806ed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc194034000 tx=0x7fc19402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.223+0000 7fc19f400640 1 -- 172.21.15.16:0/1901698258 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc198059390 con 0x7fc1a806e0c0 2024-04-26T23:34:39.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.476+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1a806c9e0 con 0x7fc1a806e0c0 2024-04-26T23:34:39.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.477+0000 7fc19f400640 1 -- 172.21.15.16:0/1901698258 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fc198058c90 con 0x7fc1a806e0c0 2024-04-26T23:34:39.481 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:39.481 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T23:34:39.481 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc18806c860 msgr2=0x7fc18806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc18806c860 0x7fc18806ed20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc194034000 tx=0x7fc19402e000 comp rx=0 tx=0).stop 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a806e0c0 msgr2=0x7fc1a814d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a806e0c0 0x7fc1a814d230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc19800c390 tx=0x7fc19800c850 comp rx=0 tx=0).stop 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 shutdown_connections 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc18806c860 0x7fc18806ed20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a8150050 0x7fc1a8141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc1a806e4a0 0x7fc1a81409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:39.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 --2- 172.21.15.16:0/1901698258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1a806e0c0 0x7fc1a814d230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:39.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 >> 172.21.15.16:0/1901698258 conn(0x7fc1a80b6630 msgr2=0x7fc1a814e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:39.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 shutdown_connections 2024-04-26T23:34:39.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:39.480+0000 7fc1ae200640 1 -- 172.21.15.16:0/1901698258 wait complete. 2024-04-26T23:34:41.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:34:41.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.699+0000 7ff547200640 1 Processor -- start 2024-04-26T23:34:41.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.699+0000 7ff547200640 1 -- start start 2024-04-26T23:34:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.701+0000 7ff547200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff5480bcc10 0x7ff5480bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.701+0000 7ff547200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5480bba50 0x7ff54809c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.701+0000 7ff547200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff548142c10 con 0x7ff54814c660 2024-04-26T23:34:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.701+0000 7ff547200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7ff5480bd530 con 0x7ff5480bcc10 2024-04-26T23:34:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.701+0000 7ff547200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff54814bb80 con 0x7ff5480bba50 2024-04-26T23:34:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.701+0000 7ff546800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff54814c660 0x7ff548073420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55166/0 (socket says 172.21.15.16:55166) 2024-04-26T23:34:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.701+0000 7ff546800640 1 -- 172.21.15.16:0/2882539562 learned_addr learned my addr 172.21.15.16:0/2882539562 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841335241 0 0) 0x7ff548142c10 con 0x7ff54814c660 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff52c003520 con 0x7ff54814c660 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff545e00640 1 --2- 172.21.15.16:0/2882539562 >> v2:172.21.15.32:3300/0 conn(0x7ff5480bcc10 0x7ff5480bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 683059197 0 0) 0x7ff52c003520 con 0x7ff54814c660 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5480bba50 msgr2=0x7ff54809c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5480bba50 0x7ff54809c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 >> v2:172.21.15.32:3300/0 conn(0x7ff5480bcc10 msgr2=0x7ff5480bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 --2- 172.21.15.16:0/2882539562 >> v2:172.21.15.32:3300/0 conn(0x7ff5480bcc10 0x7ff5480bcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54814be60 con 0x7ff54814c660 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7ff5400019f0 con 0x7ff54814c660 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 >> v1:172.21.15.16:6789/0 conn(0x7ff54814c660 legacy=0x7ff548073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff52c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff52c004800 0x7ff52c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5480bba50 0x7ff52c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480bd530 con 0x7ff52c0039b0 2024-04-26T23:34:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ff54814bb80 con 0x7ff52c004800 2024-04-26T23:34:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.702+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff52c00bba0 con 0x7ff5480bba50 2024-04-26T23:34:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.703+0000 7ff545e00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff52c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.703+0000 7ff546800640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5480bba50 0x7ff52c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.703+0000 7ff545e00640 1 -- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5480bba50 msgr2=0x7ff52c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.703+0000 7ff545e00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5480bba50 0x7ff52c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.703+0000 7ff545e00640 1 -- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff52c004800 msgr2=0x7ff52c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.703+0000 7ff545e00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff52c004800 0x7ff52c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.703+0000 7ff545e00640 1 -- 172.21.15.16:0/2882539562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c003520 con 0x7ff52c0039b0 2024-04-26T23:34:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.705+0000 7ff545e00640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff52c003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff53800ba60 tx=0x7ff52c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e7a96acaaa2a15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.705+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538030070 con 0x7ff52c0039b0 2024-04-26T23:34:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.705+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53802ae40 con 0x7ff52c0039b0 2024-04-26T23:34:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.705+0000 7ff544a00640 1 -- 172.21.15.16:0/2882539562 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53800b600 con 0x7ff52c0039b0 2024-04-26T23:34:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.706+0000 7ff547200640 1 -- 172.21.15.16:0/2882539562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 msgr2=0x7ff52c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.706+0000 7ff547200640 1 --2- 172.21.15.16:0/2882539562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff52c003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff53800ba60 tx=0x7ff52c005830 comp rx=0 tx=0).stop 2024-04-26T23:34:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.706+0000 7ff546800640 1 -- 172.21.15.16:0/2882539562 reap_dead start 2024-04-26T23:34:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.706+0000 7ff547200640 1 -- 172.21.15.16:0/2882539562 shutdown_connections 2024-04-26T23:34:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.706+0000 7ff547200640 1 -- 172.21.15.16:0/2882539562 >> 172.21.15.16:0/2882539562 conn(0x7ff548068820 msgr2=0x7ff54809f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.706+0000 7ff547200640 1 -- 172.21.15.16:0/2882539562 shutdown_connections 2024-04-26T23:34:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.706+0000 7ff547200640 1 -- 172.21.15.16:0/2882539562 wait complete. 2024-04-26T23:34:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.708+0000 7ff547200640 1 Processor -- start 2024-04-26T23:34:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.708+0000 7ff547200640 1 -- start start 2024-04-26T23:34:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff547200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff5480ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff547200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5481d3050 0x7ff5480b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff547200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5481d1e10 0x7ff5481d2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff547200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff54809bba0 con 0x7ff52c0039b0 2024-04-26T23:34:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff547200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ff54809ba20 con 0x7ff5481d3050 2024-04-26T23:34:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff547200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff54809bd20 con 0x7ff5481d1e10 2024-04-26T23:34:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff545e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff5480ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff545e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff5480ba370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50136/0 (socket says 172.21.15.16:50136) 2024-04-26T23:34:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff545e00640 1 -- 172.21.15.16:0/4190402088 learned_addr learned my addr 172.21.15.16:0/4190402088 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff546800640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5481d1e10 0x7ff5481d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff545e00640 1 -- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5481d1e10 msgr2=0x7ff5481d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff545e00640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5481d1e10 0x7ff5481d2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff545e00640 1 -- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5481d3050 msgr2=0x7ff5480b9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.709+0000 7ff545e00640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5481d3050 0x7ff5480b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.710+0000 7ff545e00640 1 -- 172.21.15.16:0/4190402088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5481d34d0 con 0x7ff52c0039b0 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.710+0000 7ff545e00640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff5480ba370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff53800bb50 tx=0x7ff538004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.710+0000 7ff53e000640 1 -- 172.21.15.16:0/4190402088 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538042020 con 0x7ff52c0039b0 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.710+0000 7ff53e000640 1 -- 172.21.15.16:0/4190402088 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53803d650 con 0x7ff52c0039b0 2024-04-26T23:34:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.710+0000 7ff53e000640 1 -- 172.21.15.16:0/4190402088 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53803da40 con 0x7ff52c0039b0 2024-04-26T23:34:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.710+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5481d28e0 con 0x7ff52c0039b0 2024-04-26T23:34:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.710+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5480b9850 con 0x7ff52c0039b0 2024-04-26T23:34:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.712+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff548069620 con 0x7ff52c0039b0 2024-04-26T23:34:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.713+0000 7ff53e000640 1 -- 172.21.15.16:0/4190402088 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff538045020 con 0x7ff52c0039b0 2024-04-26T23:34:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.714+0000 7ff53e000640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff52806c890 0x7ff52806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.714+0000 7ff53e000640 1 -- 172.21.15.16:0/4190402088 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7ff5380abf80 con 0x7ff52c0039b0 2024-04-26T23:34:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.715+0000 7ff545400640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff52806c890 0x7ff52806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.716+0000 7ff545400640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff52806c890 0x7ff52806ed50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5481d59d0 tx=0x7ff534006d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.720+0000 7ff53e000640 1 -- 172.21.15.16:0/4190402088 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff53804c030 con 0x7ff52c0039b0 2024-04-26T23:34:41.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.975+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff548076600 con 0x7ff52c0039b0 2024-04-26T23:34:41.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.976+0000 7ff53e000640 1 -- 172.21.15.16:0/4190402088 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2216 (secure 0 0 0) 0x7ff53807a740 con 0x7ff52c0039b0 2024-04-26T23:34:41.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:41.979 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1571792382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1571792382},{"type":"v1","addr":"172.21.15.32:6835","nonce":1571792382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T23:34:41.979 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff52806c890 msgr2=0x7ff52806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff52806c890 0x7ff52806ed50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5481d59d0 tx=0x7ff534006d00 comp rx=0 tx=0).stop 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 msgr2=0x7ff5480ba370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff5480ba370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff53800bb50 tx=0x7ff538004730 comp rx=0 tx=0).stop 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 shutdown_connections 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff52806c890 0x7ff52806ed50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff5481d3050 0x7ff5480b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff5481d1e10 0x7ff5481d2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 --2- 172.21.15.16:0/4190402088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff52c0039b0 0x7ff5480ba370 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 >> 172.21.15.16:0/4190402088 conn(0x7ff548068820 msgr2=0x7ff5481484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.978+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 shutdown_connections 2024-04-26T23:34:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:41.979+0000 7ff547200640 1 -- 172.21.15.16:0/4190402088 wait complete. 2024-04-26T23:34:42.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.181+0000 7f5baca00640 1 Processor -- start 2024-04-26T23:34:42.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.181+0000 7f5baca00640 1 -- start start 2024-04-26T23:34:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.182+0000 7f5baca00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba80b3b30 0x7f5ba806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.182+0000 7f5baca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ba8073c90 0x7f5ba8145500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.182+0000 7f5baca00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba80b1cc0 con 0x7f5ba8145a40 2024-04-26T23:34:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.182+0000 7f5baca00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba80b5980 con 0x7f5ba8073c90 2024-04-26T23:34:42.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.182+0000 7f5baca00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba8145eb0 con 0x7f5ba80b3b30 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ba8073c90 0x7f5ba8145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ba8073c90 0x7f5ba8145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50152/0 (socket says 172.21.15.16:50152) 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5400640 1 -- 172.21.15.16:0/2308670258 learned_addr learned my addr 172.21.15.16:0/2308670258 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5e00640 1 --2- 172.21.15.16:0/2308670258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba80b3b30 0x7f5ba806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5400640 1 -- 172.21.15.16:0/2308670258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba80b3b30 msgr2=0x7f5ba806e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5400640 1 --2- 172.21.15.16:0/2308670258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba80b3b30 0x7f5ba806e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5400640 1 -- 172.21.15.16:0/2308670258 >> v1:172.21.15.32:6789/0 conn(0x7f5ba8145a40 legacy=0x7f5ba8148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:42.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.183+0000 7f5ba5400640 1 -- 172.21.15.16:0/2308670258 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba80b1f30 con 0x7f5ba8073c90 2024-04-26T23:34:42.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.184+0000 7f5ba5400640 1 --2- 172.21.15.16:0/2308670258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba8073c90 0x7f5ba8145500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009870 tx=0x7f5b9002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e292a9848de941 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:42.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.185+0000 7f5ba4a00640 1 -- 172.21.15.16:0/2308670258 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90037070 con 0x7f5ba8073c90 2024-04-26T23:34:42.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.185+0000 7f5ba4a00640 1 -- 172.21.15.16:0/2308670258 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b90032440 con 0x7f5ba8073c90 2024-04-26T23:34:42.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.185+0000 7f5ba4a00640 1 -- 172.21.15.16:0/2308670258 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90032810 con 0x7f5ba8073c90 2024-04-26T23:34:42.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 -- 172.21.15.16:0/2308670258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba8073c90 msgr2=0x7f5ba8145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 --2- 172.21.15.16:0/2308670258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba8073c90 0x7f5ba8145500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009870 tx=0x7f5b9002a180 comp rx=0 tx=0).stop 2024-04-26T23:34:42.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 -- 172.21.15.16:0/2308670258 shutdown_connections 2024-04-26T23:34:42.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 --2- 172.21.15.16:0/2308670258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba8073c90 0x7f5ba8145500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 --2- 172.21.15.16:0/2308670258 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba80b3b30 0x7f5ba806e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 -- 172.21.15.16:0/2308670258 >> 172.21.15.16:0/2308670258 conn(0x7f5ba80b6630 msgr2=0x7f5ba80b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:42.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 -- 172.21.15.16:0/2308670258 shutdown_connections 2024-04-26T23:34:42.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.186+0000 7f5baca00640 1 -- 172.21.15.16:0/2308670258 wait complete. 2024-04-26T23:34:42.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.187+0000 7f5baca00640 1 Processor -- start 2024-04-26T23:34:42.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.188+0000 7f5baca00640 1 -- start start 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.188+0000 7f5baca00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ba8073c90 0x7f5ba813c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.188+0000 7f5baca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba80b3b30 0x7f5ba813c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.188+0000 7f5baca00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba8145a40 0x7f5ba81e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.188+0000 7f5baca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba80b0bd0 con 0x7f5ba80b3b30 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.188+0000 7f5baca00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba80b5eb0 con 0x7f5ba8073c90 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.188+0000 7f5baca00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba806e600 con 0x7f5ba8145a40 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba80b3b30 0x7f5ba813c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba80b3b30 0x7f5ba813c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50160/0 (socket says 172.21.15.16:50160) 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 -- 172.21.15.16:0/1823091713 learned_addr learned my addr 172.21.15.16:0/1823091713 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba6800640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba8145a40 0x7f5ba81e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5e00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ba8073c90 0x7f5ba813c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 -- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba8145a40 msgr2=0x7f5ba81e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba8145a40 0x7f5ba81e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 -- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ba8073c90 msgr2=0x7f5ba813c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ba8073c90 0x7f5ba813c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 -- 172.21.15.16:0/1823091713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba8071470 con 0x7f5ba80b3b30 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.189+0000 7f5ba5400640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba80b3b30 0x7f5ba813c7b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009870 tx=0x7f5b900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.190+0000 7f5b9e000640 1 -- 172.21.15.16:0/1823091713 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90041020 con 0x7f5ba80b3b30 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.190+0000 7f5b9e000640 1 -- 172.21.15.16:0/1823091713 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b90030780 con 0x7f5ba80b3b30 2024-04-26T23:34:42.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.190+0000 7f5b9e000640 1 -- 172.21.15.16:0/1823091713 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90037040 con 0x7f5ba80b3b30 2024-04-26T23:34:42.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.190+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba8141e60 con 0x7f5ba80b3b30 2024-04-26T23:34:42.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.190+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba8072fc0 con 0x7f5ba80b3b30 2024-04-26T23:34:42.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.191+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba80693a0 con 0x7f5ba80b3b30 2024-04-26T23:34:42.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.192+0000 7f5b9e000640 1 -- 172.21.15.16:0/1823091713 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f5b90044020 con 0x7f5ba80b3b30 2024-04-26T23:34:42.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.193+0000 7f5b9e000640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f5b8406c890 0x7f5b8406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.193+0000 7f5b9e000640 1 -- 172.21.15.16:0/1823091713 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5b900abee0 con 0x7f5ba80b3b30 2024-04-26T23:34:42.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.194+0000 7f5ba5e00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f5b8406c890 0x7f5b8406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.195+0000 7f5ba5e00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f5b8406c890 0x7f5b8406ed50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b98006fd0 tx=0x7f5b98008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:42.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.198+0000 7f5b9e000640 1 -- 172.21.15.16:0/1823091713 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5b9004b030 con 0x7f5ba80b3b30 2024-04-26T23:34:42.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.426+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ba80b4000 con 0x7f5ba80b3b30 2024-04-26T23:34:42.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.428+0000 7f5b9e000640 1 -- 172.21.15.16:0/1823091713 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f5b9007a730 con 0x7f5ba80b3b30 2024-04-26T23:34:42.431 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:42.431 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":16,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:41.903346+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:42.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.430+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f5b8406c890 msgr2=0x7f5b8406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.430+0000 7f5baca00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f5b8406c890 0x7f5b8406ed50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b98006fd0 tx=0x7f5b98008040 comp rx=0 tx=0).stop 2024-04-26T23:34:42.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.430+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba80b3b30 msgr2=0x7f5ba813c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.430+0000 7f5baca00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba80b3b30 0x7f5ba813c7b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009870 tx=0x7f5b900046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 shutdown_connections 2024-04-26T23:34:42.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f5b8406c890 0x7f5b8406ed50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5ba8145a40 0x7f5ba81e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ba80b3b30 0x7f5ba813c7b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 --2- 172.21.15.16:0/1823091713 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ba8073c90 0x7f5ba813c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 >> 172.21.15.16:0/1823091713 conn(0x7f5ba80b6630 msgr2=0x7f5ba80af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:42.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 shutdown_connections 2024-04-26T23:34:42.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.431+0000 7f5baca00640 1 -- 172.21.15.16:0/1823091713 wait complete. 2024-04-26T23:34:42.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:34:39.843396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:34:42.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:34:42.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:34:42.668 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:34:42.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.670+0000 7f2e43400640 1 Processor -- start 2024-04-26T23:34:42.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.670+0000 7f2e43400640 1 -- start start 2024-04-26T23:34:42.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.672+0000 7f2e43400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2e3c1484c0 0x7f2e3c153df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.672+0000 7f2e43400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3c0bea20 con 0x7f2e3c0be640 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.672+0000 7f2e43400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3c0b6630 con 0x7f2e3c0ba330 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.672+0000 7f2e43400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2e3c0b5400 con 0x7f2e3c1484c0 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e41400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2e3c1484c0 0x7f2e3c153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e40a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2e3c0be640 0x7f2e3c0b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55172/0 (socket says 172.21.15.16:55172) 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e41400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2e3c1484c0 0x7f2e3c153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50170/0 (socket says 172.21.15.16:50170) 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e40a00640 1 -- 172.21.15.16:0/92887241 learned_addr learned my addr 172.21.15.16:0/92887241 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e41400640 1 -- 172.21.15.16:0/92887241 >> v1:172.21.15.32:6789/0 conn(0x7f2e3c0ba330 legacy=0x7f2e3c142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e41400640 1 -- 172.21.15.16:0/92887241 >> v1:172.21.15.16:6789/0 conn(0x7f2e3c0be640 legacy=0x7f2e3c0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e41400640 1 -- 172.21.15.16:0/92887241 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c0b6910 con 0x7f2e3c1484c0 2024-04-26T23:34:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.673+0000 7f2e3b400640 1 -- 172.21.15.16:0/92887241 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315573873 0 0) 0x7f2e3c0bea20 con 0x7f2e3c0be640 2024-04-26T23:34:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.674+0000 7f2e41400640 1 --2- 172.21.15.16:0/92887241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c1484c0 0x7f2e3c153df0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009d90 tx=0x7f2e3402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a6dc1e62e08d70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.675+0000 7f2e3b400640 1 -- 172.21.15.16:0/92887241 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34007740 con 0x7f2e3c1484c0 2024-04-26T23:34:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.675+0000 7f2e3b400640 1 -- 172.21.15.16:0/92887241 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e340078e0 con 0x7f2e3c1484c0 2024-04-26T23:34:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.675+0000 7f2e3b400640 1 -- 172.21.15.16:0/92887241 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34007cb0 con 0x7f2e3c1484c0 2024-04-26T23:34:42.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.675+0000 7f2e43400640 1 -- 172.21.15.16:0/92887241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c1484c0 msgr2=0x7f2e3c153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.675+0000 7f2e43400640 1 --2- 172.21.15.16:0/92887241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c1484c0 0x7f2e3c153df0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009d90 tx=0x7f2e3402a660 comp rx=0 tx=0).stop 2024-04-26T23:34:42.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.675+0000 7f2e43400640 1 -- 172.21.15.16:0/92887241 shutdown_connections 2024-04-26T23:34:42.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.676+0000 7f2e43400640 1 --2- 172.21.15.16:0/92887241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c1484c0 0x7f2e3c153df0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.676+0000 7f2e43400640 1 -- 172.21.15.16:0/92887241 >> 172.21.15.16:0/92887241 conn(0x7f2e3c0686c0 msgr2=0x7f2e3c0bdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:42.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.676+0000 7f2e43400640 1 -- 172.21.15.16:0/92887241 shutdown_connections 2024-04-26T23:34:42.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.676+0000 7f2e43400640 1 -- 172.21.15.16:0/92887241 wait complete. 2024-04-26T23:34:42.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.677+0000 7f2e43400640 1 Processor -- start 2024-04-26T23:34:42.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.677+0000 7f2e43400640 1 -- start start 2024-04-26T23:34:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.678+0000 7f2e43400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c0ba330 0x7f2e3c14ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.678+0000 7f2e43400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c0be640 0x7f2e3c141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.678+0000 7f2e43400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2e3c1484c0 0x7f2e3c141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.678+0000 7f2e43400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c142a70 con 0x7f2e3c0ba330 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.678+0000 7f2e43400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c0b63b0 con 0x7f2e3c0be640 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.678+0000 7f2e43400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3c142bf0 con 0x7f2e3c1484c0 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c0ba330 0x7f2e3c14ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c0ba330 0x7f2e3c14ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50182/0 (socket says 172.21.15.16:50182) 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 -- 172.21.15.16:0/1901781655 learned_addr learned my addr 172.21.15.16:0/1901781655 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e3be00640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c0be640 0x7f2e3c141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e41400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2e3c1484c0 0x7f2e3c141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 -- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2e3c1484c0 msgr2=0x7f2e3c141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2e3c1484c0 0x7f2e3c141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 -- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c0be640 msgr2=0x7f2e3c141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c0be640 0x7f2e3c141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 -- 172.21.15.16:0/1901781655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c145460 con 0x7f2e3c0ba330 2024-04-26T23:34:42.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e41400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2e3c1484c0 0x7f2e3c141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:42.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.679+0000 7f2e40a00640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c0ba330 0x7f2e3c14ae00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c4a0 tx=0x7f2e3000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.680+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30018070 con 0x7f2e3c0ba330 2024-04-26T23:34:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.680+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e300074e0 con 0x7f2e3c0ba330 2024-04-26T23:34:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.680+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30004a20 con 0x7f2e3c0ba330 2024-04-26T23:34:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.680+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3c144fd0 con 0x7f2e3c0ba330 2024-04-26T23:34:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.680+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3c0b4bb0 con 0x7f2e3c0ba330 2024-04-26T23:34:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.681+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e3c076670 con 0x7f2e3c0ba330 2024-04-26T23:34:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.682+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f2e30004bc0 con 0x7f2e3c0ba330 2024-04-26T23:34:42.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.683+0000 7f2e38c00640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f2e1c06c890 0x7f2e1c06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:42.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.683+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2e3008a840 con 0x7f2e3c0ba330 2024-04-26T23:34:42.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.684+0000 7f2e3be00640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f2e1c06c890 0x7f2e1c06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.684+0000 7f2e3be00640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f2e1c06c890 0x7f2e1c06ed50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c144c20 tx=0x7f2e28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:42.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.688+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2e30058ae0 con 0x7f2e3c0ba330 2024-04-26T23:34:42.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.798+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e30055150 con 0x7f2e3c0ba330 2024-04-26T23:34:42.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.900+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2e3c0bd240 con 0x7f2e3c0ba330 2024-04-26T23:34:42.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.901+0000 7f2e38c00640 1 -- 172.21.15.16:0/1901781655 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f2e3007b130 con 0x7f2e3c0ba330 2024-04-26T23:34:42.904 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f2e1c06c890 msgr2=0x7f2e1c06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f2e1c06c890 0x7f2e1c06ed50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c144c20 tx=0x7f2e28009040 comp rx=0 tx=0).stop 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c0ba330 msgr2=0x7f2e3c14ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c0ba330 0x7f2e3c14ae00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c4a0 tx=0x7f2e3000c960 comp rx=0 tx=0).stop 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 shutdown_connections 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f2e1c06c890 0x7f2e1c06ed50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2e3c0be640 0x7f2e3c141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2e3c1484c0 0x7f2e3c141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 --2- 172.21.15.16:0/1901781655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e3c0ba330 0x7f2e3c14ae00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 >> 172.21.15.16:0/1901781655 conn(0x7f2e3c0686c0 msgr2=0x7f2e3c0b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 shutdown_connections 2024-04-26T23:34:42.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:42.904+0000 7f2e43400640 1 -- 172.21.15.16:0/1901781655 wait complete. 2024-04-26T23:34:42.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:34:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.190+0000 7fea4f200640 1 Processor -- start 2024-04-26T23:34:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.190+0000 7fea4f200640 1 -- start start 2024-04-26T23:34:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4f200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fea5009d270 0x7fea500bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4f200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5009c200 con 0x7fea5009be20 2024-04-26T23:34:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4f200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea500bbc30 con 0x7fea50142920 2024-04-26T23:34:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4f200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fea500bb9e0 con 0x7fea5009d270 2024-04-26T23:34:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4de00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fea5009be20 0x7fea50142210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55178/0 (socket says 172.21.15.16:55178) 2024-04-26T23:34:43.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4de00640 1 -- 172.21.15.16:0/52445290 learned_addr learned my addr 172.21.15.16:0/52445290 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4e800640 1 --2- 172.21.15.16:0/52445290 >> v2:172.21.15.32:3300/0 conn(0x7fea5009d270 0x7fea500bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680070294 0 0) 0x7fea5009c200 con 0x7fea5009be20 2024-04-26T23:34:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.192+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea34003520 con 0x7fea5009be20 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1999868349 0 0) 0x7fea34003520 con 0x7fea5009be20 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 >> v2:172.21.15.32:3300/0 conn(0x7fea5009d270 msgr2=0x7fea500bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 --2- 172.21.15.16:0/52445290 >> v2:172.21.15.32:3300/0 conn(0x7fea5009d270 0x7fea500bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 >> v1:172.21.15.32:6789/0 conn(0x7fea50142920 legacy=0x7fea50148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5009c7e0 con 0x7fea5009be20 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7fea40001670 con 0x7fea5009be20 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 >> v1:172.21.15.16:6789/0 conn(0x7fea5009be20 legacy=0x7fea50142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea34003a00 0x7fea34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea34004800 0x7fea34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea340052e0 0x7fea3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea500bb9e0 con 0x7fea340052e0 2024-04-26T23:34:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fea3400c1e0 con 0x7fea34004800 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fea3400c3e0 con 0x7fea34003a00 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.193+0000 7fea4e800640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea340052e0 0x7fea3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.194+0000 7fea4de00640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea34003a00 0x7fea34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.194+0000 7fea4d400640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea34004800 0x7fea34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.194+0000 7fea4e800640 1 -- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea34003a00 msgr2=0x7fea34003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.194+0000 7fea4e800640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea34003a00 0x7fea34003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.194+0000 7fea4e800640 1 -- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea34004800 msgr2=0x7fea34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.194+0000 7fea4e800640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea34004800 0x7fea34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.194+0000 7fea4e800640 1 -- 172.21.15.16:0/52445290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea34003520 con 0x7fea340052e0 2024-04-26T23:34:43.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.195+0000 7fea4e800640 1 -- 172.21.15.16:0/52445290 reap_dead start 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.195+0000 7fea4e800640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea340052e0 0x7fea3400b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea48009f90 tx=0x7fea34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f204201e91a4aeb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.195+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48035020 con 0x7fea340052e0 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.195+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea48003b90 con 0x7fea340052e0 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.195+0000 7fea4ca00640 1 -- 172.21.15.16:0/52445290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48009c10 con 0x7fea340052e0 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.196+0000 7fea4f200640 1 -- 172.21.15.16:0/52445290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea340052e0 msgr2=0x7fea3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.196+0000 7fea4f200640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea340052e0 0x7fea3400b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fea48009f90 tx=0x7fea34005830 comp rx=0 tx=0).stop 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.196+0000 7fea4f200640 1 -- 172.21.15.16:0/52445290 shutdown_connections 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.196+0000 7fea4f200640 1 --2- 172.21.15.16:0/52445290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea340052e0 0x7fea3400b9c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.196+0000 7fea4f200640 1 -- 172.21.15.16:0/52445290 >> 172.21.15.16:0/52445290 conn(0x7fea5009fa50 msgr2=0x7fea5009fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.196+0000 7fea4f200640 1 -- 172.21.15.16:0/52445290 shutdown_connections 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.196+0000 7fea4f200640 1 -- 172.21.15.16:0/52445290 wait complete. 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.197+0000 7fea4f200640 1 Processor -- start 2024-04-26T23:34:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.198+0000 7fea4f200640 1 -- start start 2024-04-26T23:34:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.198+0000 7fea4f200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea340052e0 0x7fea500b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.198+0000 7fea4f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea500b68e0 0x7fea500b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.198+0000 7fea4f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea500b5ae0 0x7fea501e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.198+0000 7fea4f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea500bd7f0 con 0x7fea500b68e0 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.198+0000 7fea4f200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fea500bd670 con 0x7fea500b5ae0 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.198+0000 7fea4f200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fea50142210 con 0x7fea340052e0 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea500b68e0 0x7fea500b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea500b68e0 0x7fea500b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50200/0 (socket says 172.21.15.16:50200) 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 -- 172.21.15.16:0/3205026226 learned_addr learned my addr 172.21.15.16:0/3205026226 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4de00640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea340052e0 0x7fea500b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4e800640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea500b5ae0 0x7fea501e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 -- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea340052e0 msgr2=0x7fea500b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea340052e0 0x7fea500b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 -- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea500b5ae0 msgr2=0x7fea501e0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea500b5ae0 0x7fea501e0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 -- 172.21.15.16:0/3205026226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea500a3220 con 0x7fea500b68e0 2024-04-26T23:34:43.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.199+0000 7fea4d400640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea500b68e0 0x7fea500b55a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00e4d0 tx=0x7fea3c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:43.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.200+0000 7fea46000640 1 -- 172.21.15.16:0/3205026226 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0052e0 con 0x7fea500b68e0 2024-04-26T23:34:43.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.200+0000 7fea46000640 1 -- 172.21.15.16:0/3205026226 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c018070 con 0x7fea500b68e0 2024-04-26T23:34:43.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.200+0000 7fea46000640 1 -- 172.21.15.16:0/3205026226 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c003810 con 0x7fea500b68e0 2024-04-26T23:34:43.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.200+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea500b6dc0 con 0x7fea500b68e0 2024-04-26T23:34:43.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.200+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea500a34a0 con 0x7fea500b68e0 2024-04-26T23:34:43.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.201+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea50076670 con 0x7fea500b68e0 2024-04-26T23:34:43.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.202+0000 7fea46000640 1 -- 172.21.15.16:0/3205026226 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea3c0039b0 con 0x7fea500b68e0 2024-04-26T23:34:43.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.203+0000 7fea46000640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fea3006c8f0 0x7fea3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.203+0000 7fea46000640 1 -- 172.21.15.16:0/3205026226 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fea3c08b4c0 con 0x7fea500b68e0 2024-04-26T23:34:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.204+0000 7fea4de00640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fea3006c8f0 0x7fea3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.205+0000 7fea4de00640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fea3006c8f0 0x7fea3006edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fea400058b0 tx=0x7fea40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:43.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.209+0000 7fea46000640 1 -- 172.21.15.16:0/3205026226 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fea500a3220 con 0x7fea500b68e0 2024-04-26T23:34:43.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.416+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fea500a37e0 con 0x7fea500b68e0 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.417+0000 7fea46000640 1 -- 172.21.15.16:0/3205026226 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fea3c059c30 con 0x7fea500b68e0 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T23:34:43.420 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fea3006c8f0 msgr2=0x7fea3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fea3006c8f0 0x7fea3006edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fea400058b0 tx=0x7fea40009040 comp rx=0 tx=0).stop 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea500b68e0 msgr2=0x7fea500b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea500b68e0 0x7fea500b55a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00e4d0 tx=0x7fea3c00e990 comp rx=0 tx=0).stop 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 shutdown_connections 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fea3006c8f0 0x7fea3006edb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea500b5ae0 0x7fea501e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea500b68e0 0x7fea500b55a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 --2- 172.21.15.16:0/3205026226 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fea340052e0 0x7fea500b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 >> 172.21.15.16:0/3205026226 conn(0x7fea5009fa50 msgr2=0x7fea500ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 shutdown_connections 2024-04-26T23:34:43.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.419+0000 7fea4f200640 1 -- 172.21.15.16:0/3205026226 wait complete. 2024-04-26T23:34:43.442 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:34:43.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:34:43.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.657+0000 7f149f000640 1 Processor -- start 2024-04-26T23:34:43.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.657+0000 7f149f000640 1 -- start start 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.658+0000 7f149f000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f149809be20 0x7f14980bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.658+0000 7f149f000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498142210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.658+0000 7f149f000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1498142750 0x7f149814bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.658+0000 7f149f000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f149814b900 con 0x7f1498142750 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.658+0000 7f149f000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f149809c8e0 con 0x7f149809be20 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.658+0000 7f149f000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f149809c200 con 0x7f149809d250 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.659+0000 7f149e600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1498142750 0x7f149814bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.659+0000 7f149e600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1498142750 0x7f149814bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50216/0 (socket says 172.21.15.16:50216) 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.659+0000 7f149e600640 1 -- 172.21.15.16:0/2496428652 learned_addr learned my addr 172.21.15.16:0/2496428652 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.659+0000 7f149dc00640 1 --2- 172.21.15.16:0/2496428652 >> v2:172.21.15.32:3300/0 conn(0x7f149809be20 0x7f14980bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.659+0000 7f149d200640 1 --2- 172.21.15.16:0/2496428652 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.660+0000 7f149e600640 1 -- 172.21.15.16:0/2496428652 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 msgr2=0x7f1498142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.660+0000 7f149e600640 1 --2- 172.21.15.16:0/2496428652 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.660+0000 7f149e600640 1 -- 172.21.15.16:0/2496428652 >> v2:172.21.15.32:3300/0 conn(0x7f149809be20 msgr2=0x7f14980bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.660+0000 7f149e600640 1 --2- 172.21.15.16:0/2496428652 >> v2:172.21.15.32:3300/0 conn(0x7f149809be20 0x7f14980bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.660+0000 7f149e600640 1 -- 172.21.15.16:0/2496428652 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14980bba80 con 0x7f1498142750 2024-04-26T23:34:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.660+0000 7f149d200640 1 --2- 172.21.15.16:0/2496428652 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.661+0000 7f149e600640 1 --2- 172.21.15.16:0/2496428652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814bd90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f149809bb40 tx=0x7f149002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e422ae20b124b30a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.661+0000 7f1497e00640 1 -- 172.21.15.16:0/2496428652 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490036070 con 0x7f1498142750 2024-04-26T23:34:43.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.661+0000 7f1497e00640 1 -- 172.21.15.16:0/2496428652 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1490031600 con 0x7f1498142750 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.661+0000 7f1497e00640 1 -- 172.21.15.16:0/2496428652 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14900319d0 con 0x7f1498142750 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 -- 172.21.15.16:0/2496428652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 msgr2=0x7f149814bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 --2- 172.21.15.16:0/2496428652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814bd90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f149809bb40 tx=0x7f149002a610 comp rx=0 tx=0).stop 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 -- 172.21.15.16:0/2496428652 shutdown_connections 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 --2- 172.21.15.16:0/2496428652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814bd90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 --2- 172.21.15.16:0/2496428652 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 --2- 172.21.15.16:0/2496428652 >> v2:172.21.15.32:3300/0 conn(0x7f149809be20 0x7f14980bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 -- 172.21.15.16:0/2496428652 >> 172.21.15.16:0/2496428652 conn(0x7f149809fa50 msgr2=0x7f149809fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 -- 172.21.15.16:0/2496428652 shutdown_connections 2024-04-26T23:34:43.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.662+0000 7f149f000640 1 -- 172.21.15.16:0/2496428652 wait complete. 2024-04-26T23:34:43.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.664+0000 7f149f000640 1 Processor -- start 2024-04-26T23:34:43.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.664+0000 7f149f000640 1 -- start start 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149809be20 0x7f149809e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149f000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149f000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149f000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f149814c450 con 0x7f1498142750 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f149814c2d0 con 0x7f149809be20 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149f000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f149814c5d0 con 0x7f149809d250 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50232/0 (socket says 172.21.15.16:50232) 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149e600640 1 -- 172.21.15.16:0/3049774326 learned_addr learned my addr 172.21.15.16:0/3049774326 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149dc00640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149809be20 0x7f149809e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149d200640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149e600640 1 -- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 msgr2=0x7f1498149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.665+0000 7f149e600640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f149e600640 1 -- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149809be20 msgr2=0x7f149809e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:43.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f149e600640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149809be20 0x7f149809e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:43.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f149e600640 1 -- 172.21.15.16:0/3049774326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149814b410 con 0x7f1498142750 2024-04-26T23:34:43.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f149e600640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814a080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1490034040 tx=0x7f1490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:43.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f1495600640 1 -- 172.21.15.16:0/3049774326 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490041070 con 0x7f1498142750 2024-04-26T23:34:43.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f1495600640 1 -- 172.21.15.16:0/3049774326 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149003c650 con 0x7f1498142750 2024-04-26T23:34:43.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1498149620 con 0x7f1498142750 2024-04-26T23:34:43.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f1495600640 1 -- 172.21.15.16:0/3049774326 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490036040 con 0x7f1498142750 2024-04-26T23:34:43.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.666+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f149809f4b0 con 0x7f1498142750 2024-04-26T23:34:43.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.667+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1498076600 con 0x7f1498142750 2024-04-26T23:34:43.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.668+0000 7f1495600640 1 -- 172.21.15.16:0/3049774326 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1490044070 con 0x7f1498142750 2024-04-26T23:34:43.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.669+0000 7f1495600640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f147806c8f0 0x7f147806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:43.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.669+0000 7f1495600640 1 -- 172.21.15.16:0/3049774326 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f14900ac160 con 0x7f1498142750 2024-04-26T23:34:43.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.670+0000 7f149dc00640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f147806c8f0 0x7f147806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:43.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.671+0000 7f149dc00640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f147806c8f0 0x7f147806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f148c009b40 tx=0x7f148c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.674+0000 7f1495600640 1 -- 172.21.15.16:0/3049774326 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f149007a280 con 0x7f1498142750 2024-04-26T23:34:43.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:43.879+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f14981497f0 con 0x7f1498142750 2024-04-26T23:34:44.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.031+0000 7f1495600640 1 -- 172.21.15.16:0/3049774326 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f149007e580 con 0x7f1498142750 2024-04-26T23:34:44.035 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-04-26T23:34:44.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.035+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f147806c8f0 msgr2=0x7f147806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:44.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.035+0000 7f149f000640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f147806c8f0 0x7f147806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f148c009b40 tx=0x7f148c009190 comp rx=0 tx=0).stop 2024-04-26T23:34:44.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.035+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 msgr2=0x7f149814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.035+0000 7f149f000640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814a080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1490034040 tx=0x7f1490004a40 comp rx=0 tx=0).stop 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.036+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 shutdown_connections 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.036+0000 7f149f000640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f147806c8f0 0x7f147806edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.036+0000 7f149f000640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1498142750 0x7f149814a080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.036+0000 7f149f000640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f149809d250 0x7f1498149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.036+0000 7f149f000640 1 --2- 172.21.15.16:0/3049774326 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f149809be20 0x7f149809e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.036+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 >> 172.21.15.16:0/3049774326 conn(0x7f149809fa50 msgr2=0x7f1498073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.036+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 shutdown_connections 2024-04-26T23:34:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.037+0000 7f149f000640 1 -- 172.21.15.16:0/3049774326 wait complete. 2024-04-26T23:34:44.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:34:44.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.277+0000 7efe3c400640 1 Processor -- start 2024-04-26T23:34:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.277+0000 7efe3c400640 1 -- start start 2024-04-26T23:34:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.278+0000 7efe3c400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe3414a150 0x7efe341400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.278+0000 7efe3c400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe34070210 0x7efe34140630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe3c400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe34140b70 con 0x7efe340b3220 2024-04-26T23:34:44.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe3c400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7efe340b3c20 con 0x7efe3414a150 2024-04-26T23:34:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe3c400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7efe340715c0 con 0x7efe34070210 2024-04-26T23:34:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe39000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe3414a150 0x7efe341400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe39a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7efe340b3220 0x7efe34149a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55192/0 (socket says 172.21.15.16:55192) 2024-04-26T23:34:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe39a00640 1 -- 172.21.15.16:0/3180422107 learned_addr learned my addr 172.21.15.16:0/3180422107 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:44.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe3a400640 1 --2- 172.21.15.16:0/3180422107 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe34070210 0x7efe34140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:44.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.279+0000 7efe33e00640 1 -- 172.21.15.16:0/3180422107 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738252813 0 0) 0x7efe34140b70 con 0x7efe340b3220 2024-04-26T23:34:44.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.280+0000 7efe33e00640 1 -- 172.21.15.16:0/3180422107 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe1c003520 con 0x7efe340b3220 2024-04-26T23:34:44.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.280+0000 7efe39000640 1 -- 172.21.15.16:0/3180422107 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe34070210 msgr2=0x7efe34140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:44.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.280+0000 7efe39000640 1 --2- 172.21.15.16:0/3180422107 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe34070210 0x7efe34140630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.280+0000 7efe39000640 1 -- 172.21.15.16:0/3180422107 >> v1:172.21.15.16:6789/0 conn(0x7efe340b3220 legacy=0x7efe34149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:44.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.280+0000 7efe39000640 1 -- 172.21.15.16:0/3180422107 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe340b3600 con 0x7efe3414a150 2024-04-26T23:34:44.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.280+0000 7efe3a400640 1 --2- 172.21.15.16:0/3180422107 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe34070210 0x7efe34140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:44.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.281+0000 7efe39000640 1 --2- 172.21.15.16:0/3180422107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3414a150 0x7efe341400f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe200097a0 tx=0x7efe2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8405300cd149d8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:44.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.281+0000 7efe33e00640 1 -- 172.21.15.16:0/3180422107 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20037070 con 0x7efe3414a150 2024-04-26T23:34:44.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.281+0000 7efe33e00640 1 -- 172.21.15.16:0/3180422107 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe20032440 con 0x7efe3414a150 2024-04-26T23:34:44.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.281+0000 7efe33e00640 1 -- 172.21.15.16:0/3180422107 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20032810 con 0x7efe3414a150 2024-04-26T23:34:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 -- 172.21.15.16:0/3180422107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3414a150 msgr2=0x7efe341400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 --2- 172.21.15.16:0/3180422107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3414a150 0x7efe341400f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe200097a0 tx=0x7efe2002a180 comp rx=0 tx=0).stop 2024-04-26T23:34:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 -- 172.21.15.16:0/3180422107 shutdown_connections 2024-04-26T23:34:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 --2- 172.21.15.16:0/3180422107 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe34070210 0x7efe34140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 --2- 172.21.15.16:0/3180422107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3414a150 0x7efe341400f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 -- 172.21.15.16:0/3180422107 >> 172.21.15.16:0/3180422107 conn(0x7efe340b99a0 msgr2=0x7efe340b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:44.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 -- 172.21.15.16:0/3180422107 shutdown_connections 2024-04-26T23:34:44.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.282+0000 7efe3c400640 1 -- 172.21.15.16:0/3180422107 wait complete. 2024-04-26T23:34:44.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.283+0000 7efe3c400640 1 Processor -- start 2024-04-26T23:34:44.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.284+0000 7efe3c400640 1 -- start start 2024-04-26T23:34:44.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.284+0000 7efe3c400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe34070210 0x7efe340b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:44.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.284+0000 7efe3c400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe340b3220 0x7efe341e1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.284+0000 7efe3c400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe3414a150 0x7efe34139c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.284+0000 7efe3c400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe340b38b0 con 0x7efe340b3220 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.284+0000 7efe3c400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7efe34070730 con 0x7efe34070210 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.284+0000 7efe3c400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7efe34071240 con 0x7efe3414a150 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe340b3220 0x7efe341e1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe340b3220 0x7efe341e1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50246/0 (socket says 172.21.15.16:50246) 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 -- 172.21.15.16:0/1832920576 learned_addr learned my addr 172.21.15.16:0/1832920576 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe3a400640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe3414a150 0x7efe34139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39a00640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe34070210 0x7efe340b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:44.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 -- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe3414a150 msgr2=0x7efe34139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe3414a150 0x7efe34139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 -- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe34070210 msgr2=0x7efe340b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe34070210 0x7efe340b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 -- 172.21.15.16:0/1832920576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe340af900 con 0x7efe340b3220 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39a00640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe34070210 0x7efe340b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.285+0000 7efe39000640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe340b3220 0x7efe341e1210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe20035040 tx=0x7efe200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.286+0000 7efe31600640 1 -- 172.21.15.16:0/1832920576 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20037040 con 0x7efe340b3220 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.286+0000 7efe31600640 1 -- 172.21.15.16:0/1832920576 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe20030500 con 0x7efe340b3220 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.286+0000 7efe31600640 1 -- 172.21.15.16:0/1832920576 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe200308d0 con 0x7efe340b3220 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.286+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe340b2720 con 0x7efe340b3220 2024-04-26T23:34:44.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.286+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe340b0820 con 0x7efe340b3220 2024-04-26T23:34:44.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.287+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe34076670 con 0x7efe340b3220 2024-04-26T23:34:44.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.288+0000 7efe31600640 1 -- 172.21.15.16:0/1832920576 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe20044020 con 0x7efe340b3220 2024-04-26T23:34:44.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.289+0000 7efe31600640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efe1406c8f0 0x7efe1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:44.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.289+0000 7efe31600640 1 -- 172.21.15.16:0/1832920576 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7efe200abc50 con 0x7efe340b3220 2024-04-26T23:34:44.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.290+0000 7efe39a00640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efe1406c8f0 0x7efe1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:44.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.292+0000 7efe39a00640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efe1406c8f0 0x7efe1406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe28007fd0 tx=0x7efe28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:44.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.295+0000 7efe31600640 1 -- 172.21.15.16:0/1832920576 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efe2007a250 con 0x7efe340b3220 2024-04-26T23:34:44.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:44.502+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efe340afe50 con 0x7efe340b3220 2024-04-26T23:34:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.038+0000 7efe31600640 1 -- 172.21.15.16:0/1832920576 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7efe20079b50 con 0x7efe340b3220 2024-04-26T23:34:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-04-26T23:34:45.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.041+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efe1406c8f0 msgr2=0x7efe1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:45.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.041+0000 7efe3c400640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efe1406c8f0 0x7efe1406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe28007fd0 tx=0x7efe28009040 comp rx=0 tx=0).stop 2024-04-26T23:34:45.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.041+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe340b3220 msgr2=0x7efe341e1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:45.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.041+0000 7efe3c400640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe340b3220 0x7efe341e1210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe20035040 tx=0x7efe200046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.041+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 shutdown_connections 2024-04-26T23:34:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.042+0000 7efe3c400640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efe1406c8f0 0x7efe1406edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.042+0000 7efe3c400640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efe3414a150 0x7efe34139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.042+0000 7efe3c400640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe340b3220 0x7efe341e1210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.042+0000 7efe3c400640 1 --2- 172.21.15.16:0/1832920576 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe34070210 0x7efe340b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.042+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 >> 172.21.15.16:0/1832920576 conn(0x7efe340b99a0 msgr2=0x7efe3413cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.042+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 shutdown_connections 2024-04-26T23:34:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.042+0000 7efe3c400640 1 -- 172.21.15.16:0/1832920576 wait complete. 2024-04-26T23:34:45.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:34:45.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.256+0000 7f105b600640 1 Processor -- start 2024-04-26T23:34:45.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.257+0000 7f105b600640 1 -- start start 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f105b600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10540b68a0 0x7f105414ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f105b600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10540bb1a0 0x7f1054142050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f105b600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1054142590 0x7f10540b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f105b600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f10540ba650 con 0x7f1054142590 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f105b600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f10540b7b50 con 0x7f10540bb1a0 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f105b600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f10540b7da0 con 0x7f10540b68a0 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f1059600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1054142590 0x7f10540b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:45.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f1059600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1054142590 0x7f10540b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50256/0 (socket says 172.21.15.16:50256) 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f1059600640 1 -- 172.21.15.16:0/1078584735 learned_addr learned my addr 172.21.15.16:0/1078584735 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.258+0000 7f1058c00640 1 --2- 172.21.15.16:0/1078584735 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10540b68a0 0x7f105414ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.259+0000 7f1053e00640 1 --2- 172.21.15.16:0/1078584735 >> v2:172.21.15.32:3300/0 conn(0x7f10540bb1a0 0x7f1054142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.259+0000 7f1059600640 1 -- 172.21.15.16:0/1078584735 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10540b68a0 msgr2=0x7f105414ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.259+0000 7f1059600640 1 --2- 172.21.15.16:0/1078584735 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10540b68a0 0x7f105414ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.259+0000 7f1059600640 1 -- 172.21.15.16:0/1078584735 >> v2:172.21.15.32:3300/0 conn(0x7f10540bb1a0 msgr2=0x7f1054142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.259+0000 7f1059600640 1 --2- 172.21.15.16:0/1078584735 >> v2:172.21.15.32:3300/0 conn(0x7f10540bb1a0 0x7f1054142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.259+0000 7f1059600640 1 -- 172.21.15.16:0/1078584735 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10540ba370 con 0x7f1054142590 2024-04-26T23:34:45.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.259+0000 7f1053e00640 1 --2- 172.21.15.16:0/1078584735 >> v2:172.21.15.32:3300/0 conn(0x7f10540bb1a0 0x7f1054142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:45.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.260+0000 7f1059600640 1 --2- 172.21.15.16:0/1078584735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054142590 0x7f10540b86f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10540bb630 tx=0x7f104c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7f7411a13d8282 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:45.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.260+0000 7f1053400640 1 -- 172.21.15.16:0/1078584735 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c036070 con 0x7f1054142590 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.260+0000 7f1053400640 1 -- 172.21.15.16:0/1078584735 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c031600 con 0x7f1054142590 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.260+0000 7f1053400640 1 -- 172.21.15.16:0/1078584735 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c0319d0 con 0x7f1054142590 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 -- 172.21.15.16:0/1078584735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054142590 msgr2=0x7f10540b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 --2- 172.21.15.16:0/1078584735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054142590 0x7f10540b86f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10540bb630 tx=0x7f104c02a6c0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 -- 172.21.15.16:0/1078584735 shutdown_connections 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 --2- 172.21.15.16:0/1078584735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054142590 0x7f10540b86f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 --2- 172.21.15.16:0/1078584735 >> v2:172.21.15.32:3300/0 conn(0x7f10540bb1a0 0x7f1054142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 --2- 172.21.15.16:0/1078584735 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10540b68a0 0x7f105414ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 -- 172.21.15.16:0/1078584735 >> 172.21.15.16:0/1078584735 conn(0x7f10540684e0 msgr2=0x7f10540688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 -- 172.21.15.16:0/1078584735 shutdown_connections 2024-04-26T23:34:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.261+0000 7f105b600640 1 -- 172.21.15.16:0/1078584735 wait complete. 2024-04-26T23:34:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.263+0000 7f105b600640 1 Processor -- start 2024-04-26T23:34:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.263+0000 7f105b600640 1 -- start start 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f105b600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10540b68a0 0x7f105413a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f105b600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10540bb1a0 0x7f105413cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f105b600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1054142590 0x7f105413d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f105b600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10540b6c80 con 0x7f10540b68a0 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f105b600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f10540b5800 con 0x7f10540bb1a0 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f105b600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f10540b5d20 con 0x7f1054142590 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10540b68a0 0x7f105413a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10540b68a0 0x7f105413a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50270/0 (socket says 172.21.15.16:50270) 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 -- 172.21.15.16:0/3062940725 learned_addr learned my addr 172.21.15.16:0/3062940725 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 -- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1054142590 msgr2=0x7f105413d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1054142590 0x7f105413d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 -- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10540bb1a0 msgr2=0x7f105413cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:45.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1053e00640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10540bb1a0 0x7f105413cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:45.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10540bb1a0 0x7f105413cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:45.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.264+0000 7f1058c00640 1 -- 172.21.15.16:0/3062940725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1054148860 con 0x7f10540b68a0 2024-04-26T23:34:45.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.265+0000 7f1058c00640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10540b68a0 0x7f105413a7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f104800d830 tx=0x7f104800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:45.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.265+0000 7f1050c00640 1 -- 172.21.15.16:0/3062940725 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800b6c0 con 0x7f10540b68a0 2024-04-26T23:34:45.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.265+0000 7f1050c00640 1 -- 172.21.15.16:0/3062940725 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1048019070 con 0x7f10540b68a0 2024-04-26T23:34:45.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.265+0000 7f1050c00640 1 -- 172.21.15.16:0/3062940725 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800ba80 con 0x7f10540b68a0 2024-04-26T23:34:45.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.265+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105413c160 con 0x7f10540b68a0 2024-04-26T23:34:45.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.265+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1054148580 con 0x7f10540b68a0 2024-04-26T23:34:45.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.266+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1054076670 con 0x7f10540b68a0 2024-04-26T23:34:45.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.267+0000 7f1050c00640 1 -- 172.21.15.16:0/3062940725 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f104801e460 con 0x7f10540b68a0 2024-04-26T23:34:45.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.269+0000 7f1050c00640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f103406c8f0 0x7f103406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:45.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.269+0000 7f1050c00640 1 -- 172.21.15.16:0/3062940725 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f104808c140 con 0x7f10540b68a0 2024-04-26T23:34:45.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.269+0000 7f1053e00640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f103406c8f0 0x7f103406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:45.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.271+0000 7f1053e00640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f103406c8f0 0x7f103406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1054149440 tx=0x7f1040008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:45.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.275+0000 7f1050c00640 1 -- 172.21.15.16:0/3062940725 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f104805a660 con 0x7f10540b68a0 2024-04-26T23:34:45.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:45.527+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f10540bbcf0 con 0x7f10540b68a0 2024-04-26T23:34:46.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.080+0000 7f1050c00640 1 -- 172.21.15.16:0/3062940725 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1048059f60 con 0x7f10540b68a0 2024-04-26T23:34:46.084 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T23:34:46.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.086+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f103406c8f0 msgr2=0x7f103406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.086+0000 7f105b600640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f103406c8f0 0x7f103406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1054149440 tx=0x7f1040008040 comp rx=0 tx=0).stop 2024-04-26T23:34:46.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.086+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10540b68a0 msgr2=0x7f105413a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.086+0000 7f105b600640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10540b68a0 0x7f105413a7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f104800d830 tx=0x7f104800dcf0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.087+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 shutdown_connections 2024-04-26T23:34:46.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.087+0000 7f105b600640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f103406c8f0 0x7f103406edb0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1054149440 tx=0x7f1040008040 comp rx=0 tx=0).stop 2024-04-26T23:34:46.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.087+0000 7f105b600640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10540bb1a0 0x7f105413cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.087+0000 7f105b600640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1054142590 0x7f105413d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.087+0000 7f105b600640 1 --2- 172.21.15.16:0/3062940725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10540b68a0 0x7f105413a7d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.087+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 >> 172.21.15.16:0/3062940725 conn(0x7f10540684e0 msgr2=0x7f105406a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:46.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.088+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 shutdown_connections 2024-04-26T23:34:46.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.089+0000 7f105b600640 1 -- 172.21.15.16:0/3062940725 wait complete. 2024-04-26T23:34:46.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:46.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.302+0000 7f2974a00640 1 Processor -- start 2024-04-26T23:34:46.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.302+0000 7f2974a00640 1 -- start start 2024-04-26T23:34:46.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f2974a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2970073600 0x7f29701461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f2974a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29700701e0 0x7f2970146700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f2974a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29700b6e70 con 0x7f29700b6a90 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f2974a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2970146c40 con 0x7f2970073600 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f2974a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f29700b3cf0 con 0x7f29700701e0 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f296f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f29700b6a90 0x7f2970072ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55198/0 (socket says 172.21.15.16:55198) 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f2967e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2970073600 0x7f29701461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.303+0000 7f296f400640 1 -- 172.21.15.16:0/4003566048 learned_addr learned my addr 172.21.15.16:0/4003566048 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.304+0000 7f296fe00640 1 --2- 172.21.15.16:0/4003566048 >> v2:172.21.15.32:3300/0 conn(0x7f29700701e0 0x7f2970146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.304+0000 7f296ea00640 1 -- 172.21.15.16:0/4003566048 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408561216 0 0) 0x7f29700b6e70 con 0x7f29700b6a90 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.304+0000 7f296ea00640 1 -- 172.21.15.16:0/4003566048 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2954003520 con 0x7f29700b6a90 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.304+0000 7f2967e00640 1 -- 172.21.15.16:0/4003566048 >> v2:172.21.15.32:3300/0 conn(0x7f29700701e0 msgr2=0x7f2970146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.304+0000 7f2967e00640 1 --2- 172.21.15.16:0/4003566048 >> v2:172.21.15.32:3300/0 conn(0x7f29700701e0 0x7f2970146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.304+0000 7f2967e00640 1 -- 172.21.15.16:0/4003566048 >> v1:172.21.15.16:6789/0 conn(0x7f29700b6a90 legacy=0x7f2970072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.304+0000 7f2967e00640 1 -- 172.21.15.16:0/4003566048 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29700b39a0 con 0x7f2970073600 2024-04-26T23:34:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.305+0000 7f2967e00640 1 --2- 172.21.15.16:0/4003566048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2970073600 0x7f29701461c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29700b3c60 tx=0x7f295802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509cd6ef0f53c75f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.305+0000 7f296ea00640 1 -- 172.21.15.16:0/4003566048 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958037070 con 0x7f2970073600 2024-04-26T23:34:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.305+0000 7f296ea00640 1 -- 172.21.15.16:0/4003566048 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295802add0 con 0x7f2970073600 2024-04-26T23:34:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.305+0000 7f296ea00640 1 -- 172.21.15.16:0/4003566048 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958032660 con 0x7f2970073600 2024-04-26T23:34:46.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 -- 172.21.15.16:0/4003566048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2970073600 msgr2=0x7f29701461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 --2- 172.21.15.16:0/4003566048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2970073600 0x7f29701461c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29700b3c60 tx=0x7f295802a080 comp rx=0 tx=0).stop 2024-04-26T23:34:46.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 -- 172.21.15.16:0/4003566048 shutdown_connections 2024-04-26T23:34:46.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 --2- 172.21.15.16:0/4003566048 >> v2:172.21.15.32:3300/0 conn(0x7f29700701e0 0x7f2970146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 --2- 172.21.15.16:0/4003566048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2970073600 0x7f29701461c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 -- 172.21.15.16:0/4003566048 >> 172.21.15.16:0/4003566048 conn(0x7f2970068270 msgr2=0x7f2970068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:46.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 -- 172.21.15.16:0/4003566048 shutdown_connections 2024-04-26T23:34:46.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.306+0000 7f2974a00640 1 -- 172.21.15.16:0/4003566048 wait complete. 2024-04-26T23:34:46.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.308+0000 7f2974a00640 1 Processor -- start 2024-04-26T23:34:46.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.308+0000 7f2974a00640 1 -- start start 2024-04-26T23:34:46.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f2974a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700701e0 0x7f29701de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f2974a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2970073600 0x7f2970142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f2974a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29700b6a90 0x7f29701e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f2974a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29700714b0 con 0x7f29700b6a90 2024-04-26T23:34:46.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f2974a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f2970073eb0 con 0x7f29700701e0 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f2974a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f2970070770 con 0x7f2970073600 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f296fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29700b6a90 0x7f29701e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f296fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29700b6a90 0x7f29701e0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50288/0 (socket says 172.21.15.16:50288) 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f296fe00640 1 -- 172.21.15.16:0/2778964174 learned_addr learned my addr 172.21.15.16:0/2778964174 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f296f400640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700701e0 0x7f29701de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.309+0000 7f2967e00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2970073600 0x7f2970142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f296fe00640 1 -- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2970073600 msgr2=0x7f2970142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f296fe00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2970073600 0x7f2970142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f296fe00640 1 -- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700701e0 msgr2=0x7f29701de0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f296fe00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700701e0 0x7f29701de0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f296fe00640 1 -- 172.21.15.16:0/2778964174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29701de600 con 0x7f29700b6a90 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f296fe00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29700b6a90 0x7f29701e0c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2968007e40 tx=0x7f296800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f2967400640 1 -- 172.21.15.16:0/2778964174 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968014620 con 0x7f29700b6a90 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f2967400640 1 -- 172.21.15.16:0/2778964174 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2968019070 con 0x7f29700b6a90 2024-04-26T23:34:46.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f2967400640 1 -- 172.21.15.16:0/2778964174 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968014a20 con 0x7f29700b6a90 2024-04-26T23:34:46.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29701cccc0 con 0x7f29700b6a90 2024-04-26T23:34:46.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.310+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29701dd8c0 con 0x7f29700b6a90 2024-04-26T23:34:46.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.312+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29701dd6b0 con 0x7f29700b6a90 2024-04-26T23:34:46.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.313+0000 7f2967400640 1 -- 172.21.15.16:0/2778964174 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2968014bc0 con 0x7f29700b6a90 2024-04-26T23:34:46.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.314+0000 7f2967400640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f294c06c8f0 0x7f294c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.314+0000 7f2967400640 1 -- 172.21.15.16:0/2778964174 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f296808c380 con 0x7f29700b6a90 2024-04-26T23:34:46.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.314+0000 7f296f400640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f294c06c8f0 0x7f294c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.315+0000 7f296f400640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f294c06c8f0 0x7f294c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2960007fd0 tx=0x7f2960009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:46.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.318+0000 7f2967400640 1 -- 172.21.15.16:0/2778964174 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f296805a840 con 0x7f29700b6a90 2024-04-26T23:34:46.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.524+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29701cc9e0 con 0x7f29700b6a90 2024-04-26T23:34:46.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.526+0000 7f2967400640 1 -- 172.21.15.16:0/2778964174 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16574 (secure 0 0 0) 0x7f296805a140 con 0x7f29700b6a90 2024-04-26T23:34:46.530 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:46.530 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:45.529091+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f294c06c8f0 msgr2=0x7f294c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f294c06c8f0 0x7f294c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2960007fd0 tx=0x7f2960009040 comp rx=0 tx=0).stop 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29700b6a90 msgr2=0x7f29701e0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29700b6a90 0x7f29701e0c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2968007e40 tx=0x7f296800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 shutdown_connections 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f294c06c8f0 0x7f294c06edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29700b6a90 0x7f29701e0c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f2970073600 0x7f2970142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 --2- 172.21.15.16:0/2778964174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700701e0 0x7f29701de0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 >> 172.21.15.16:0/2778964174 conn(0x7f2970068270 msgr2=0x7f29700b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:46.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 shutdown_connections 2024-04-26T23:34:46.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.529+0000 7f2974a00640 1 -- 172.21.15.16:0/2778964174 wait complete. 2024-04-26T23:34:46.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:46.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.757+0000 7fcf22000640 1 Processor -- start 2024-04-26T23:34:46.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.758+0000 7fcf22000640 1 -- start start 2024-04-26T23:34:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.759+0000 7fcf22000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf1c14c760 0x7fcf1c09ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.759+0000 7fcf22000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf1c0bbd60 con 0x7fcf1c09c060 2024-04-26T23:34:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.759+0000 7fcf22000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf1c0bc040 con 0x7fcf1c09c440 2024-04-26T23:34:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.759+0000 7fcf22000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcf1c14bbc0 con 0x7fcf1c14c760 2024-04-26T23:34:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.759+0000 7fcf1b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcf1c09c060 0x7fcf1c142510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55212/0 (socket says 172.21.15.16:55212) 2024-04-26T23:34:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.759+0000 7fcf1b400640 1 -- 172.21.15.16:0/4103732729 learned_addr learned my addr 172.21.15.16:0/4103732729 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.760+0000 7fcf1be00640 1 --2- 172.21.15.16:0/4103732729 >> v2:172.21.15.16:3300/0 conn(0x7fcf1c14c760 0x7fcf1c09ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.760+0000 7fcf1a000640 1 -- 172.21.15.16:0/4103732729 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761308279 0 0) 0x7fcf1c0bbd60 con 0x7fcf1c09c060 2024-04-26T23:34:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.760+0000 7fcf1a000640 1 -- 172.21.15.16:0/4103732729 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcefc003520 con 0x7fcf1c09c060 2024-04-26T23:34:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.760+0000 7fcf1be00640 1 -- 172.21.15.16:0/4103732729 >> v1:172.21.15.32:6789/0 conn(0x7fcf1c09c440 legacy=0x7fcf1c14c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.760+0000 7fcf1be00640 1 -- 172.21.15.16:0/4103732729 >> v1:172.21.15.16:6789/0 conn(0x7fcf1c09c060 legacy=0x7fcf1c142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.760+0000 7fcf1be00640 1 -- 172.21.15.16:0/4103732729 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c142c20 con 0x7fcf1c14c760 2024-04-26T23:34:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.761+0000 7fcf1be00640 1 --2- 172.21.15.16:0/4103732729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c14c760 0x7fcf1c09ca60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf140097a0 tx=0x7fcf1402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1815782d72b46002 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.761+0000 7fcf1a000640 1 -- 172.21.15.16:0/4103732729 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14037070 con 0x7fcf1c14c760 2024-04-26T23:34:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.761+0000 7fcf1a000640 1 -- 172.21.15.16:0/4103732729 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf14032440 con 0x7fcf1c14c760 2024-04-26T23:34:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.761+0000 7fcf1a000640 1 -- 172.21.15.16:0/4103732729 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14032810 con 0x7fcf1c14c760 2024-04-26T23:34:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.762+0000 7fcf22000640 1 -- 172.21.15.16:0/4103732729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c14c760 msgr2=0x7fcf1c09ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.762+0000 7fcf22000640 1 --2- 172.21.15.16:0/4103732729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c14c760 0x7fcf1c09ca60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf140097a0 tx=0x7fcf1402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.762+0000 7fcf22000640 1 -- 172.21.15.16:0/4103732729 shutdown_connections 2024-04-26T23:34:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.762+0000 7fcf22000640 1 --2- 172.21.15.16:0/4103732729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c14c760 0x7fcf1c09ca60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.762+0000 7fcf22000640 1 -- 172.21.15.16:0/4103732729 >> 172.21.15.16:0/4103732729 conn(0x7fcf1c09fbd0 msgr2=0x7fcf1c09ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.762+0000 7fcf22000640 1 -- 172.21.15.16:0/4103732729 shutdown_connections 2024-04-26T23:34:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.762+0000 7fcf22000640 1 -- 172.21.15.16:0/4103732729 wait complete. 2024-04-26T23:34:46.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.764+0000 7fcf22000640 1 Processor -- start 2024-04-26T23:34:46.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.764+0000 7fcf22000640 1 -- start start 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf22000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c09c060 0x7fcf1c141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf22000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf1c09c440 0x7fcf1c14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf22000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcf1c14c760 0x7fcf1c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf22000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c154110 con 0x7fcf1c09c060 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf22000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c09c8a0 con 0x7fcf1c09c440 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf22000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1c154290 con 0x7fcf1c14c760 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf1b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c09c060 0x7fcf1c141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf1b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c09c060 0x7fcf1c141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50314/0 (socket says 172.21.15.16:50314) 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.765+0000 7fcf1b400640 1 -- 172.21.15.16:0/1784739537 learned_addr learned my addr 172.21.15.16:0/1784739537 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1be00640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcf1c14c760 0x7fcf1c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1b400640 1 -- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcf1c14c760 msgr2=0x7fcf1c14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1b400640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcf1c14c760 0x7fcf1c14ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1b400640 1 -- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf1c09c440 msgr2=0x7fcf1c14a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1aa00640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf1c09c440 0x7fcf1c14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1b400640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf1c09c440 0x7fcf1c14a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1b400640 1 -- 172.21.15.16:0/1784739537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c1e1d20 con 0x7fcf1c09c060 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1aa00640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf1c09c440 0x7fcf1c14a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf1b400640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c09c060 0x7fcf1c141830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00c500 tx=0x7fcf0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf13400640 1 -- 172.21.15.16:0/1784739537 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c017070 con 0x7fcf1c09c060 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf13400640 1 -- 172.21.15.16:0/1784739537 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0c005ce0 con 0x7fcf1c09c060 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf13400640 1 -- 172.21.15.16:0/1784739537 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c007330 con 0x7fcf1c09c060 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.766+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1c144260 con 0x7fcf1c09c060 2024-04-26T23:34:46.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.767+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf1c143f80 con 0x7fcf1c09c060 2024-04-26T23:34:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.768+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf1c0693a0 con 0x7fcf1c09c060 2024-04-26T23:34:46.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.769+0000 7fcf13400640 1 -- 172.21.15.16:0/1784739537 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf0c01a070 con 0x7fcf1c09c060 2024-04-26T23:34:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.770+0000 7fcf13400640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcef806c8f0 0x7fcef806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.770+0000 7fcf13400640 1 -- 172.21.15.16:0/1784739537 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fcf0c08afe0 con 0x7fcf1c09c060 2024-04-26T23:34:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.770+0000 7fcf1aa00640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcef806c8f0 0x7fcef806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:46.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.772+0000 7fcf1aa00640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcef806c8f0 0x7fcef806edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0a3d20 tx=0x7fcf04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:46.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.774+0000 7fcf13400640 1 -- 172.21.15.16:0/1784739537 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcf0c059520 con 0x7fcf1c09c060 2024-04-26T23:34:46.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.982+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf1c0b9fb0 con 0x7fcf1c09c060 2024-04-26T23:34:46.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.983+0000 7fcf13400640 1 -- 172.21.15.16:0/1784739537 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16574 (secure 0 0 0) 0x7fcf0c058e20 con 0x7fcf1c09c060 2024-04-26T23:34:46.987 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:46.987 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:45.529091+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:46.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcef806c8f0 msgr2=0x7fcef806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcef806c8f0 0x7fcef806edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0a3d20 tx=0x7fcf04009040 comp rx=0 tx=0).stop 2024-04-26T23:34:46.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c09c060 msgr2=0x7fcf1c141830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c09c060 0x7fcf1c141830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00c500 tx=0x7fcf0c00c9c0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 shutdown_connections 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcef806c8f0 0x7fcef806edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcf1c09c440 0x7fcf1c14a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcf1c14c760 0x7fcf1c14ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 --2- 172.21.15.16:0/1784739537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf1c09c060 0x7fcf1c141830 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 >> 172.21.15.16:0/1784739537 conn(0x7fcf1c09fbd0 msgr2=0x7fcf1c147f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 shutdown_connections 2024-04-26T23:34:46.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:46.986+0000 7fcf22000640 1 -- 172.21.15.16:0/1784739537 wait complete. 2024-04-26T23:34:47.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:34:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.225+0000 7fcef0c00640 1 Processor -- start 2024-04-26T23:34:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.226+0000 7fcef0c00640 1 -- start start 2024-04-26T23:34:47.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcef0c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fceec0b4590 0x7fceec145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:47.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcef0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fceec072ea0 0x7fceec073300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:47.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcef0c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceec0b4970 con 0x7fceec148790 2024-04-26T23:34:47.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcef0c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fceec0707d0 con 0x7fceec072ea0 2024-04-26T23:34:47.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcef0c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fceec0b5df0 con 0x7fceec0b4590 2024-04-26T23:34:47.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcee9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fceec072ea0 0x7fceec073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcee9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fceec072ea0 0x7fceec073300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35054/0 (socket says 172.21.15.16:35054) 2024-04-26T23:34:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.227+0000 7fcee9400640 1 -- 172.21.15.16:0/109042534 learned_addr learned my addr 172.21.15.16:0/109042534 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.228+0000 7fcee9400640 1 -- 172.21.15.16:0/109042534 >> v2:172.21.15.32:3300/0 conn(0x7fceec0b4590 msgr2=0x7fceec145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.228+0000 7fcee9400640 1 --2- 172.21.15.16:0/109042534 >> v2:172.21.15.32:3300/0 conn(0x7fceec0b4590 0x7fceec145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.228+0000 7fcee9400640 1 -- 172.21.15.16:0/109042534 >> v1:172.21.15.32:6789/0 conn(0x7fceec148790 legacy=0x7fceec148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.228+0000 7fcee9400640 1 -- 172.21.15.16:0/109042534 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec145570 con 0x7fceec072ea0 2024-04-26T23:34:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.229+0000 7fcee9400640 1 --2- 172.21.15.16:0/109042534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec073300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fceec0b7430 tx=0x7fced402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446f385631fb97a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.229+0000 7fcee8a00640 1 -- 172.21.15.16:0/109042534 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4037070 con 0x7fceec072ea0 2024-04-26T23:34:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.229+0000 7fcee8a00640 1 -- 172.21.15.16:0/109042534 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced402ae20 con 0x7fceec072ea0 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.229+0000 7fcee8a00640 1 -- 172.21.15.16:0/109042534 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4032660 con 0x7fceec072ea0 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 -- 172.21.15.16:0/109042534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 msgr2=0x7fceec073300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 --2- 172.21.15.16:0/109042534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec073300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fceec0b7430 tx=0x7fced402a110 comp rx=0 tx=0).stop 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 -- 172.21.15.16:0/109042534 shutdown_connections 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 --2- 172.21.15.16:0/109042534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec073300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 --2- 172.21.15.16:0/109042534 >> v2:172.21.15.32:3300/0 conn(0x7fceec0b4590 0x7fceec145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 -- 172.21.15.16:0/109042534 >> 172.21.15.16:0/109042534 conn(0x7fceec0b99a0 msgr2=0x7fceec0b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 -- 172.21.15.16:0/109042534 shutdown_connections 2024-04-26T23:34:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.230+0000 7fcef0c00640 1 -- 172.21.15.16:0/109042534 wait complete. 2024-04-26T23:34:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 Processor -- start 2024-04-26T23:34:47.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 -- start start 2024-04-26T23:34:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec1473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceec0b4590 0x7fceec138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fceec148790 0x7fceec1392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fceec0b0da0 con 0x7fceec072ea0 2024-04-26T23:34:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fceec145220 con 0x7fceec0b4590 2024-04-26T23:34:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.232+0000 7fcef0c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fceec145fd0 con 0x7fceec148790 2024-04-26T23:34:47.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec1473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:47.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec1473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35058/0 (socket says 172.21.15.16:35058) 2024-04-26T23:34:47.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 -- 172.21.15.16:0/4157026579 learned_addr learned my addr 172.21.15.16:0/4157026579 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 -- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fceec148790 msgr2=0x7fceec1392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fceec148790 0x7fceec1392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 -- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceec0b4590 msgr2=0x7fceec138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceec0b4590 0x7fceec138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:47.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.233+0000 7fcee9e00640 1 -- 172.21.15.16:0/4157026579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec0b0700 con 0x7fceec072ea0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.234+0000 7fcee9e00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec1473e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00b420 tx=0x7fcedc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.234+0000 7fcee2000640 1 -- 172.21.15.16:0/4157026579 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc005970 con 0x7fceec072ea0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.234+0000 7fcee2000640 1 -- 172.21.15.16:0/4157026579 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc005b10 con 0x7fceec072ea0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.234+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceec13b3c0 con 0x7fceec072ea0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.234+0000 7fcee2000640 1 -- 172.21.15.16:0/4157026579 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc006020 con 0x7fceec072ea0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.234+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceec147d50 con 0x7fceec072ea0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.235+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceec147f90 con 0x7fceec072ea0 2024-04-26T23:34:47.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.236+0000 7fcee2000640 1 -- 172.21.15.16:0/4157026579 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcedc018020 con 0x7fceec072ea0 2024-04-26T23:34:47.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.237+0000 7fcee2000640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcec806c8f0 0x7fcec806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:47.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.237+0000 7fcee2000640 1 -- 172.21.15.16:0/4157026579 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcedc08b1a0 con 0x7fceec072ea0 2024-04-26T23:34:47.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.238+0000 7fcee9400640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcec806c8f0 0x7fcec806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:47.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.239+0000 7fcee9400640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcec806c8f0 0x7fcec806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fced4034000 tx=0x7fced402c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:47.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.242+0000 7fcee2000640 1 -- 172.21.15.16:0/4157026579 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fceec147f90 con 0x7fceec072ea0 2024-04-26T23:34:47.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:47.496+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fceec076670 con 0x7fceec072ea0 2024-04-26T23:34:48.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.079+0000 7fcee2000640 1 -- 172.21.15.16:0/4157026579 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7fcedc0595c0 con 0x7fceec072ea0 2024-04-26T23:34:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.083+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcec806c8f0 msgr2=0x7fcec806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.083+0000 7fcef0c00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcec806c8f0 0x7fcec806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fced4034000 tx=0x7fced402c000 comp rx=0 tx=0).stop 2024-04-26T23:34:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.083+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 msgr2=0x7fceec1473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.083+0000 7fcef0c00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec1473e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00b420 tx=0x7fcedc00b8e0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 shutdown_connections 2024-04-26T23:34:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcec806c8f0 0x7fcec806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fceec0b4590 0x7fceec138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fceec148790 0x7fceec1392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 --2- 172.21.15.16:0/4157026579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceec072ea0 0x7fceec1473e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 >> 172.21.15.16:0/4157026579 conn(0x7fceec0b99a0 msgr2=0x7fceec073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:48.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 shutdown_connections 2024-04-26T23:34:48.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.084+0000 7fcef0c00640 1 -- 172.21.15.16:0/4157026579 wait complete. 2024-04-26T23:34:48.111 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:34:48.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:34:48.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.326+0000 7f74ad400640 1 Processor -- start 2024-04-26T23:34:48.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.326+0000 7f74ad400640 1 -- start start 2024-04-26T23:34:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74ad400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 0x7f74a80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74ad400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74a8150e20 0x7f74a8153210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74ad400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74a80b0910 con 0x7f74a80b6940 2024-04-26T23:34:48.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74ad400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f74a80af3c0 con 0x7f74a8150e20 2024-04-26T23:34:48.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74ad400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f74a80b6d20 con 0x7f74a80b28d0 2024-04-26T23:34:48.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74a7e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f74a80b6940 0x7f74a80b4390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32792/0 (socket says 172.21.15.16:32792) 2024-04-26T23:34:48.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74a7e00640 1 -- 172.21.15.16:0/1141348413 learned_addr learned my addr 172.21.15.16:0/1141348413 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:48.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.328+0000 7f74a7400640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 0x7f74a80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74aca00640 1 --2- 172.21.15.16:0/1141348413 >> v2:172.21.15.32:3300/0 conn(0x7f74a8150e20 0x7f74a8153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364533528 0 0) 0x7f74a80b0910 con 0x7f74a80b6940 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f748c003520 con 0x7f74a80b6940 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3387132383 0 0) 0x7f748c003520 con 0x7f74a80b6940 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 msgr2=0x7f74a80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 0x7f74a80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 >> v2:172.21.15.32:3300/0 conn(0x7f74a8150e20 msgr2=0x7f74a8153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:48.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 --2- 172.21.15.16:0/1141348413 >> v2:172.21.15.32:3300/0 conn(0x7f74a8150e20 0x7f74a8153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a80af660 con 0x7f74a80b6940 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f7498001670 con 0x7f74a80b6940 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a7400640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 0x7f74a80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 >> v1:172.21.15.16:6789/0 conn(0x7f74a80b6940 legacy=0x7f74a80b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0039b0 0x7f748c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c004800 0x7f748c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 0x7f748c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80af3c0 con 0x7f748c0039b0 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80b6d20 con 0x7f748c004800 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f748c00ba70 con 0x7f74a80b28d0 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.329+0000 7f74a7e00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0039b0 0x7f748c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.330+0000 7f74a7e00640 1 -- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 msgr2=0x7f748c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.330+0000 7f74a7e00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74a80b28d0 0x7f748c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.330+0000 7f74a7e00640 1 -- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c004800 msgr2=0x7f748c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:48.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.330+0000 7f74a7e00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f748c004800 0x7f748c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.330+0000 7f74a7e00640 1 -- 172.21.15.16:0/1141348413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c003520 con 0x7f748c0039b0 2024-04-26T23:34:48.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.331+0000 7f74a7e00640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0039b0 0x7f748c003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f749800c290 tx=0x7f748c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dbb7700c62a294 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.331+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498007d50 con 0x7f748c0039b0 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.331+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7498005af0 con 0x7f748c0039b0 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.331+0000 7f74a6a00640 1 -- 172.21.15.16:0/1141348413 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498007070 con 0x7f748c0039b0 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.332+0000 7f74ad400640 1 -- 172.21.15.16:0/1141348413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0039b0 msgr2=0x7f748c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.332+0000 7f74ad400640 1 --2- 172.21.15.16:0/1141348413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f748c0039b0 0x7f748c003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f749800c290 tx=0x7f748c005830 comp rx=0 tx=0).stop 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.332+0000 7f74aca00640 1 -- 172.21.15.16:0/1141348413 reap_dead start 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.332+0000 7f74ad400640 1 -- 172.21.15.16:0/1141348413 shutdown_connections 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.332+0000 7f74ad400640 1 -- 172.21.15.16:0/1141348413 >> 172.21.15.16:0/1141348413 conn(0x7f74a8068270 msgr2=0x7f74a8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:48.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.332+0000 7f74ad400640 1 -- 172.21.15.16:0/1141348413 shutdown_connections 2024-04-26T23:34:48.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.332+0000 7f74ad400640 1 -- 172.21.15.16:0/1141348413 wait complete. 2024-04-26T23:34:48.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.333+0000 7f74ad400640 1 Processor -- start 2024-04-26T23:34:48.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.334+0000 7f74ad400640 1 -- start start 2024-04-26T23:34:48.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.334+0000 7f74ad400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f748c0039b0 0x7f74a80700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.334+0000 7f74ad400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74a814df90 0x7f74a8072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.334+0000 7f74ad400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a814d070 0x7f74a81e1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.334+0000 7f74ad400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80ae8a0 con 0x7f74a814df90 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.334+0000 7f74ad400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80aee90 con 0x7f74a814d070 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.334+0000 7f74ad400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f74a80aea20 con 0x7f748c0039b0 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74a814df90 0x7f74a8072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74a814df90 0x7f74a8072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35080/0 (socket says 172.21.15.16:35080) 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 -- 172.21.15.16:0/112565929 learned_addr learned my addr 172.21.15.16:0/112565929 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7e00640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f748c0039b0 0x7f74a80700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 -- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f748c0039b0 msgr2=0x7f74a80700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f748c0039b0 0x7f74a80700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 -- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a814d070 msgr2=0x7f74a81e1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:48.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a814d070 0x7f74a81e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 -- 172.21.15.16:0/112565929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a814e470 con 0x7f74a814df90 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.335+0000 7f74a7400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74a814df90 0x7f74a8072ef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f749400e7f0 tx=0x7f749400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.336+0000 7f749fe00640 1 -- 172.21.15.16:0/112565929 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494004030 con 0x7f74a814df90 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.336+0000 7f749fe00640 1 -- 172.21.15.16:0/112565929 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74940041f0 con 0x7f74a814df90 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.336+0000 7f749fe00640 1 -- 172.21.15.16:0/112565929 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749400c8c0 con 0x7f74a814df90 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.336+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a814e750 con 0x7f74a814df90 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.336+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a80726f0 con 0x7f74a814df90 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.337+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a814d480 con 0x7f74a814df90 2024-04-26T23:34:48.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.338+0000 7f749fe00640 1 -- 172.21.15.16:0/112565929 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f749400ca60 con 0x7f74a814df90 2024-04-26T23:34:48.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.339+0000 7f749fe00640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f748806c920 0x7f748806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:48.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.340+0000 7f749fe00640 1 -- 172.21.15.16:0/112565929 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f749408bf40 con 0x7f74a814df90 2024-04-26T23:34:48.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.340+0000 7f74a7e00640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f748806c920 0x7f748806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:48.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.341+0000 7f74a7e00640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f748806c920 0x7f748806ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7498033000 tx=0x7f7498009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:48.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.344+0000 7f749fe00640 1 -- 172.21.15.16:0/112565929 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f74a814d480 con 0x7f74a814df90 2024-04-26T23:34:48.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:48.590+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f74a8076600 con 0x7f74a814df90 2024-04-26T23:34:49.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.082+0000 7f749fe00640 1 -- 172.21.15.16:0/112565929 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f7494017020 con 0x7f74a814df90 2024-04-26T23:34:49.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f748806c920 msgr2=0x7f748806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f748806c920 0x7f748806ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7498033000 tx=0x7f7498009030 comp rx=0 tx=0).stop 2024-04-26T23:34:49.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74a814df90 msgr2=0x7f74a8072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74a814df90 0x7f74a8072ef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f749400e7f0 tx=0x7f749400ecb0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 shutdown_connections 2024-04-26T23:34:49.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f748806c920 0x7f748806ede0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a814d070 0x7f74a81e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74a814df90 0x7f74a8072ef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 --2- 172.21.15.16:0/112565929 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f748c0039b0 0x7f74a80700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 >> 172.21.15.16:0/112565929 conn(0x7f74a8068270 msgr2=0x7f74a80b7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:49.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 shutdown_connections 2024-04-26T23:34:49.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.086+0000 7f74ad400640 1 -- 172.21.15.16:0/112565929 wait complete. 2024-04-26T23:34:49.110 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:34:49.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:34:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.317+0000 7fdcbb200640 1 Processor -- start 2024-04-26T23:34:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.318+0000 7fdcbb200640 1 -- start start 2024-04-26T23:34:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcbb200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdcbc0bcc10 0x7fdcbc0bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcbb200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdcbc14c660 0x7fdcbc152d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcbb200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcbc142c10 con 0x7fdcbc0bba50 2024-04-26T23:34:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcbb200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdcbc0bd530 con 0x7fdcbc14c660 2024-04-26T23:34:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcbb200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fdcbc14bb80 con 0x7fdcbc0bcc10 2024-04-26T23:34:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcba800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdcbc14c660 0x7fdcbc152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcba800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdcbc14c660 0x7fdcbc152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35082/0 (socket says 172.21.15.16:35082) 2024-04-26T23:34:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.319+0000 7fdcba800640 1 -- 172.21.15.16:0/1212685315 learned_addr learned my addr 172.21.15.16:0/1212685315 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.320+0000 7fdcb9e00640 1 --2- 172.21.15.16:0/1212685315 >> v2:172.21.15.32:3300/0 conn(0x7fdcbc0bcc10 0x7fdcbc0bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.320+0000 7fdcba800640 1 -- 172.21.15.16:0/1212685315 >> v2:172.21.15.32:3300/0 conn(0x7fdcbc0bcc10 msgr2=0x7fdcbc0bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.320+0000 7fdcba800640 1 --2- 172.21.15.16:0/1212685315 >> v2:172.21.15.32:3300/0 conn(0x7fdcbc0bcc10 0x7fdcbc0bcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.320+0000 7fdcba800640 1 -- 172.21.15.16:0/1212685315 >> v1:172.21.15.32:6789/0 conn(0x7fdcbc0bba50 legacy=0x7fdcbc09c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.320+0000 7fdcba800640 1 -- 172.21.15.16:0/1212685315 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc14be60 con 0x7fdcbc14c660 2024-04-26T23:34:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.321+0000 7fdcba800640 1 --2- 172.21.15.16:0/1212685315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc152d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009870 tx=0x7fdcb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1641acae0a9175d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcb8a00640 1 -- 172.21.15.16:0/1212685315 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4037070 con 0x7fdcbc14c660 2024-04-26T23:34:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcb8a00640 1 -- 172.21.15.16:0/1212685315 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb4032440 con 0x7fdcbc14c660 2024-04-26T23:34:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcb8a00640 1 -- 172.21.15.16:0/1212685315 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4032810 con 0x7fdcbc14c660 2024-04-26T23:34:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcbb200640 1 -- 172.21.15.16:0/1212685315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 msgr2=0x7fdcbc152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcbb200640 1 --2- 172.21.15.16:0/1212685315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc152d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009870 tx=0x7fdcb402a270 comp rx=0 tx=0).stop 2024-04-26T23:34:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcbb200640 1 -- 172.21.15.16:0/1212685315 shutdown_connections 2024-04-26T23:34:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcbb200640 1 --2- 172.21.15.16:0/1212685315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc152d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcbb200640 1 --2- 172.21.15.16:0/1212685315 >> v2:172.21.15.32:3300/0 conn(0x7fdcbc0bcc10 0x7fdcbc0bcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.322+0000 7fdcbb200640 1 -- 172.21.15.16:0/1212685315 >> 172.21.15.16:0/1212685315 conn(0x7fdcbc068820 msgr2=0x7fdcbc09f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.323+0000 7fdcbb200640 1 -- 172.21.15.16:0/1212685315 shutdown_connections 2024-04-26T23:34:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.323+0000 7fdcbb200640 1 -- 172.21.15.16:0/1212685315 wait complete. 2024-04-26T23:34:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.324+0000 7fdcbb200640 1 Processor -- start 2024-04-26T23:34:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.324+0000 7fdcbb200640 1 -- start start 2024-04-26T23:34:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcbb200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdcbc0bba50 0x7fdcbc0b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcbb200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcbc0bcc10 0x7fdcbc1de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcbb200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc1de640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcbb200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc09bba0 con 0x7fdcbc14c660 2024-04-26T23:34:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcbb200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc09ba20 con 0x7fdcbc0bcc10 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcbb200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc09bd20 con 0x7fdcbc0bba50 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcba800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc1de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcba800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc1de640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35084/0 (socket says 172.21.15.16:35084) 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.325+0000 7fdcba800640 1 -- 172.21.15.16:0/4136596373 learned_addr learned my addr 172.21.15.16:0/4136596373 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcba800640 1 -- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdcbc0bba50 msgr2=0x7fdcbc0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcb9e00640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdcbc0bba50 0x7fdcbc0b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcba800640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdcbc0bba50 0x7fdcbc0b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcba800640 1 -- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcbc0bcc10 msgr2=0x7fdcbc1de100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcba800640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcbc0bcc10 0x7fdcbc1de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcba800640 1 -- 172.21.15.16:0/4136596373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc1d31e0 con 0x7fdcbc14c660 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcb9e00640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdcbc0bba50 0x7fdcbc0b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:49.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcba800640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc1de640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdcb402a2b0 tx=0x7fdcb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcb2000640 1 -- 172.21.15.16:0/4136596373 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4041020 con 0x7fdcbc14c660 2024-04-26T23:34:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.326+0000 7fdcb2000640 1 -- 172.21.15.16:0/4136596373 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb4030800 con 0x7fdcbc14c660 2024-04-26T23:34:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.327+0000 7fdcb2000640 1 -- 172.21.15.16:0/4136596373 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4037040 con 0x7fdcbc14c660 2024-04-26T23:34:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.327+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc0b6700 con 0x7fdcbc14c660 2024-04-26T23:34:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.327+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc1d42a0 con 0x7fdcbc14c660 2024-04-26T23:34:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.328+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc069620 con 0x7fdcbc14c660 2024-04-26T23:34:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.329+0000 7fdcb2000640 1 -- 172.21.15.16:0/4136596373 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcb4044020 con 0x7fdcbc14c660 2024-04-26T23:34:49.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.330+0000 7fdcb2000640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fdc9806c8f0 0x7fdc9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.330+0000 7fdcb2000640 1 -- 172.21.15.16:0/4136596373 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdcb40ac4d0 con 0x7fdcbc14c660 2024-04-26T23:34:49.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.331+0000 7fdcb9e00640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fdc9806c8f0 0x7fdc9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.332+0000 7fdcb9e00640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fdc9806c8f0 0x7fdc9806edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcac008890 tx=0x7fdcac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.335+0000 7fdcb2000640 1 -- 172.21.15.16:0/4136596373 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdcb404b030 con 0x7fdcbc14c660 2024-04-26T23:34:49.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.582+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcbc076600 con 0x7fdcbc14c660 2024-04-26T23:34:49.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.582+0000 7fdcb2000640 1 -- 172.21.15.16:0/4136596373 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fdcb407a8f0 con 0x7fdcbc14c660 2024-04-26T23:34:49.586 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:49.586 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:34:45.529018+0000","modified":"2024-04-26T23:34:48.591854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1571792382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1571792382},{"type":"v1","addr":"172.21.15.32:6835","nonce":1571792382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-26T23:34:49.586 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-26T23:34:49.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fdc9806c8f0 msgr2=0x7fdc9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fdc9806c8f0 0x7fdc9806edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcac008890 tx=0x7fdcac008040 comp rx=0 tx=0).stop 2024-04-26T23:34:49.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 msgr2=0x7fdcbc1de640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc1de640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdcb402a2b0 tx=0x7fdcb40046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 shutdown_connections 2024-04-26T23:34:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fdc9806c8f0 0x7fdc9806edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdcbc0bcc10 0x7fdcbc1de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcbc14c660 0x7fdcbc1de640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 --2- 172.21.15.16:0/4136596373 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdcbc0bba50 0x7fdcbc0b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 >> 172.21.15.16:0/4136596373 conn(0x7fdcbc068820 msgr2=0x7fdcbc1497e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:49.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.585+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 shutdown_connections 2024-04-26T23:34:49.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.586+0000 7fdcbb200640 1 -- 172.21.15.16:0/4136596373 wait complete. 2024-04-26T23:34:49.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:49.761 INFO:tasks.ceph.mds.b.smithi032.stderr:2024-04-26T23:34:49.757+0000 7f4093400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:34:49.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.814+0000 7f866ea00640 1 Processor -- start 2024-04-26T23:34:49.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.814+0000 7f866ea00640 1 -- start start 2024-04-26T23:34:49.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866ea00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bbc30 0x7f8668148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f86680bd7a0 0x7f86680baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866ea00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86680bc010 con 0x7f8668073420 2024-04-26T23:34:49.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866ea00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8668149220 con 0x7f86680bd7a0 2024-04-26T23:34:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866ea00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f8668148220 con 0x7f86680bbc30 2024-04-26T23:34:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f86680bd7a0 0x7f86680baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866e000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8668073420 0x7f8668073cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32800/0 (socket says 172.21.15.16:32800) 2024-04-26T23:34:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866e000640 1 -- 172.21.15.16:0/773414760 learned_addr learned my addr 172.21.15.16:0/773414760 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.816+0000 7f866d600640 1 --2- 172.21.15.16:0/773414760 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bbc30 0x7f8668148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.817+0000 7f866cc00640 1 -- 172.21.15.16:0/773414760 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bbc30 msgr2=0x7f8668148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.817+0000 7f866cc00640 1 --2- 172.21.15.16:0/773414760 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bbc30 0x7f8668148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.817+0000 7f866cc00640 1 -- 172.21.15.16:0/773414760 >> v1:172.21.15.16:6789/0 conn(0x7f8668073420 legacy=0x7f8668073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.817+0000 7f866cc00640 1 -- 172.21.15.16:0/773414760 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86681484e0 con 0x7f86680bd7a0 2024-04-26T23:34:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.818+0000 7f866cc00640 1 --2- 172.21.15.16:0/773414760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86680bd7a0 0x7f86680baa10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f86540097a0 tx=0x7f865402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28a1540e4cd7e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.818+0000 7f8667e00640 1 -- 172.21.15.16:0/773414760 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654037070 con 0x7f86680bd7a0 2024-04-26T23:34:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.818+0000 7f8667e00640 1 -- 172.21.15.16:0/773414760 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865402adb0 con 0x7f86680bd7a0 2024-04-26T23:34:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.818+0000 7f8667e00640 1 -- 172.21.15.16:0/773414760 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654032660 con 0x7f86680bd7a0 2024-04-26T23:34:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.818+0000 7f866ea00640 1 -- 172.21.15.16:0/773414760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86680bd7a0 msgr2=0x7f86680baa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.818+0000 7f866ea00640 1 --2- 172.21.15.16:0/773414760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86680bd7a0 0x7f86680baa10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f86540097a0 tx=0x7f865402a060 comp rx=0 tx=0).stop 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.819+0000 7f866ea00640 1 -- 172.21.15.16:0/773414760 shutdown_connections 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.819+0000 7f866ea00640 1 --2- 172.21.15.16:0/773414760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86680bd7a0 0x7f86680baa10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.819+0000 7f866ea00640 1 --2- 172.21.15.16:0/773414760 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bbc30 0x7f8668148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.819+0000 7f866ea00640 1 -- 172.21.15.16:0/773414760 >> 172.21.15.16:0/773414760 conn(0x7f866809fc60 msgr2=0x7f86680a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.819+0000 7f866ea00640 1 -- 172.21.15.16:0/773414760 shutdown_connections 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.819+0000 7f866ea00640 1 -- 172.21.15.16:0/773414760 wait complete. 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.820+0000 7f866ea00640 1 Processor -- start 2024-04-26T23:34:49.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866ea00640 1 -- start start 2024-04-26T23:34:49.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8668073420 0x7f86680b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86680bbc30 0x7f8668141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866ea00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bd7a0 0x7f86681424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866ea00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8668074400 con 0x7f8668073420 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866ea00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f86680baf50 con 0x7f86680bbc30 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866ea00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f8668074580 con 0x7f86680bd7a0 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.821+0000 7f866d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8668073420 0x7f86680b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8668073420 0x7f86680b73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35102/0 (socket says 172.21.15.16:35102) 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 -- 172.21.15.16:0/209004091 learned_addr learned my addr 172.21.15.16:0/209004091 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 -- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bd7a0 msgr2=0x7f86681424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bd7a0 0x7f86681424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 -- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86680bbc30 msgr2=0x7f8668141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86680bbc30 0x7f8668141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 -- 172.21.15.16:0/209004091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86681495c0 con 0x7f8668073420 2024-04-26T23:34:49.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866d600640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8668073420 0x7f86680b73f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f865c00d800 tx=0x7f865c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:49.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f8665600640 1 -- 172.21.15.16:0/209004091 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c00b6c0 con 0x7f8668073420 2024-04-26T23:34:49.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f8665600640 1 -- 172.21.15.16:0/209004091 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865c019070 con 0x7f8668073420 2024-04-26T23:34:49.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f8665600640 1 -- 172.21.15.16:0/209004091 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c00ba60 con 0x7f8668073420 2024-04-26T23:34:49.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.822+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8668149aa0 con 0x7f8668073420 2024-04-26T23:34:49.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.823+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86681d26b0 con 0x7f8668073420 2024-04-26T23:34:49.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.824+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86681493e0 con 0x7f8668073420 2024-04-26T23:34:49.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.825+0000 7f8665600640 1 -- 172.21.15.16:0/209004091 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f865c00bc00 con 0x7f8668073420 2024-04-26T23:34:49.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.826+0000 7f8665600640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:49.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.826+0000 7f8665600640 1 -- 172.21.15.16:0/209004091 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f865c08bff0 con 0x7f8668073420 2024-04-26T23:34:49.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.827+0000 7f866cc00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:49.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.828+0000 7f866cc00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f865402c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:49.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:49.831+0000 7f8665600640 1 -- 172.21.15.16:0/209004091 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f86681493e0 con 0x7f8668073420 2024-04-26T23:34:50.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.035+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8668076600 con 0x7f8668073420 2024-04-26T23:34:50.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.037+0000 7f8665600640 1 -- 172.21.15.16:0/209004091 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16561 (secure 0 0 0) 0x7f865c011340 con 0x7f8668073420 2024-04-26T23:34:50.042 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:50.042 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:47.057746+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f864806c8f0 msgr2=0x7f864806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f865402c000 comp rx=0 tx=0).stop 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8668073420 msgr2=0x7f86680b73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8668073420 0x7f86680b73f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f865c00d800 tx=0x7f865c00dcc0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 shutdown_connections 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f86680bbc30 0x7f8668141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f86680bd7a0 0x7f86681424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 --2- 172.21.15.16:0/209004091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8668073420 0x7f86680b73f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 >> 172.21.15.16:0/209004091 conn(0x7f866809fc60 msgr2=0x7f866809bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 shutdown_connections 2024-04-26T23:34:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.040+0000 7f866ea00640 1 -- 172.21.15.16:0/209004091 wait complete. 2024-04-26T23:34:50.064 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:34:50.064 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:34:50.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.267+0000 7f33f0a00640 1 Processor -- start 2024-04-26T23:34:50.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.267+0000 7f33f0a00640 1 -- start start 2024-04-26T23:34:50.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.269+0000 7f33f0a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f33ec140930 0x7f33ec0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.269+0000 7f33f0a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec06e710 con 0x7f33ec06e330 2024-04-26T23:34:50.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.269+0000 7f33f0a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec0b63d0 con 0x7f33ec0b37a0 2024-04-26T23:34:50.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.269+0000 7f33f0a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f33ec0b1ec0 con 0x7f33ec140930 2024-04-26T23:34:50.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.269+0000 7f33e9e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f33ec06e330 0x7f33ec073860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32810/0 (socket says 172.21.15.16:32810) 2024-04-26T23:34:50.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.269+0000 7f33e9e00640 1 -- 172.21.15.16:0/4068204320 learned_addr learned my addr 172.21.15.16:0/4068204320 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33ea800640 1 --2- 172.21.15.16:0/4068204320 >> v2:172.21.15.32:3300/0 conn(0x7f33ec140930 0x7f33ec0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302963371 0 0) 0x7f33ec06e710 con 0x7f33ec06e330 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33d0003520 con 0x7f33ec06e330 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 704977276 0 0) 0x7f33d0003520 con 0x7f33ec06e330 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 >> v2:172.21.15.32:3300/0 conn(0x7f33ec140930 msgr2=0x7f33ec0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 --2- 172.21.15.16:0/4068204320 >> v2:172.21.15.32:3300/0 conn(0x7f33ec140930 0x7f33ec0b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 >> v1:172.21.15.32:6789/0 conn(0x7f33ec0b37a0 legacy=0x7f33ec140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec0b1870 con 0x7f33ec06e330 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f33dc001670 con 0x7f33ec06e330 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 >> v1:172.21.15.16:6789/0 conn(0x7f33ec06e330 legacy=0x7f33ec073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33d0003a00 0x7f33d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33d0004800 0x7f33d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0b1ec0 con 0x7f33d0005210 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f33d000c160 con 0x7f33d0004800 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.270+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f33d000c360 con 0x7f33d0003a00 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33ea800640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33e9e00640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33d0003a00 0x7f33d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33e3e00640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33d0004800 0x7f33d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33ea800640 1 -- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33d0003a00 msgr2=0x7f33d0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33ea800640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33d0003a00 0x7f33d0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33ea800640 1 -- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33d0004800 msgr2=0x7f33d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33ea800640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33d0004800 0x7f33d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.271+0000 7f33ea800640 1 -- 172.21.15.16:0/4068204320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d0003520 con 0x7f33d0005210 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.272+0000 7f33ea800640 1 -- 172.21.15.16:0/4068204320 reap_dead start 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.272+0000 7f33ea800640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33d000b9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009f90 tx=0x7f33d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a994ec483a1ac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:50.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4035020 con 0x7f33d0005210 2024-04-26T23:34:50.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e4003b90 con 0x7f33d0005210 2024-04-26T23:34:50.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33e9400640 1 -- 172.21.15.16:0/4068204320 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4009c10 con 0x7f33d0005210 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33f0a00640 1 -- 172.21.15.16:0/4068204320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 msgr2=0x7f33d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33f0a00640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33d000b9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009f90 tx=0x7f33d0005830 comp rx=0 tx=0).stop 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33f0a00640 1 -- 172.21.15.16:0/4068204320 shutdown_connections 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33f0a00640 1 --2- 172.21.15.16:0/4068204320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33d000b9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33f0a00640 1 -- 172.21.15.16:0/4068204320 >> 172.21.15.16:0/4068204320 conn(0x7f33ec0b6630 msgr2=0x7f33ec0b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33f0a00640 1 -- 172.21.15.16:0/4068204320 shutdown_connections 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.273+0000 7f33f0a00640 1 -- 172.21.15.16:0/4068204320 wait complete. 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.275+0000 7f33f0a00640 1 Processor -- start 2024-04-26T23:34:50.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.275+0000 7f33f0a00640 1 -- start start 2024-04-26T23:34:50.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33f0a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33ec1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33f0a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33ec1dd9a0 0x7f33ec1dde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33f0a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33ec1e0f10 0x7f33ec1e1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33f0a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0b3d60 con 0x7f33d0005210 2024-04-26T23:34:50.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33f0a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0b3be0 con 0x7f33ec1e0f10 2024-04-26T23:34:50.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33f0a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f33ec0b3ee0 con 0x7f33ec1dd9a0 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33e9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33ec1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33e9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33ec1498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35126/0 (socket says 172.21.15.16:35126) 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.276+0000 7f33e9e00640 1 -- 172.21.15.16:0/3606889501 learned_addr learned my addr 172.21.15.16:0/3606889501 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e3e00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33ec1dd9a0 0x7f33ec1dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e9e00640 1 -- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33ec1dd9a0 msgr2=0x7f33ec1dde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33ea800640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33ec1e0f10 0x7f33ec1e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e9e00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33ec1dd9a0 0x7f33ec1dde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e9e00640 1 -- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33ec1e0f10 msgr2=0x7f33ec1e1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e9e00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33ec1e0f10 0x7f33ec1e1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e9e00640 1 -- 172.21.15.16:0/3606889501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec13e8e0 con 0x7f33d0005210 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e3e00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33ec1dd9a0 0x7f33ec1dde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:50.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e9e00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33ec1498f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00e800 tx=0x7f33dc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:50.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.277+0000 7f33e2000640 1 -- 172.21.15.16:0/3606889501 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00c6c0 con 0x7f33d0005210 2024-04-26T23:34:50.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.278+0000 7f33e2000640 1 -- 172.21.15.16:0/3606889501 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33dc018070 con 0x7f33d0005210 2024-04-26T23:34:50.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.278+0000 7f33e2000640 1 -- 172.21.15.16:0/3606889501 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00caa0 con 0x7f33d0005210 2024-04-26T23:34:50.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.278+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ec1de360 con 0x7f33d0005210 2024-04-26T23:34:50.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.278+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ec071720 con 0x7f33d0005210 2024-04-26T23:34:50.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.279+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ec0693a0 con 0x7f33d0005210 2024-04-26T23:34:50.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.280+0000 7f33e2000640 1 -- 172.21.15.16:0/3606889501 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33dc00cc40 con 0x7f33d0005210 2024-04-26T23:34:50.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.281+0000 7f33e2000640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f33c806c8f0 0x7f33c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.281+0000 7f33e2000640 1 -- 172.21.15.16:0/3606889501 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f33dc08b860 con 0x7f33d0005210 2024-04-26T23:34:50.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.281+0000 7f33e3e00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f33c806c8f0 0x7f33c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.283+0000 7f33e3e00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f33c806c8f0 0x7f33c806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33d4000c00 tx=0x7f33d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:50.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.286+0000 7f33e2000640 1 -- 172.21.15.16:0/3606889501 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f33ec1de360 con 0x7f33d0005210 2024-04-26T23:34:50.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.485+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33ec0b5250 con 0x7f33c806c8f0 2024-04-26T23:34:50.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.508+0000 7f33e2000640 1 -- 172.21.15.16:0/3606889501 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7f33ec0b5250 con 0x7f33c806c8f0 2024-04-26T23:34:50.515 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:50.516 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.513+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f33c806c8f0 msgr2=0x7f33c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.513+0000 7f33f0a00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f33c806c8f0 0x7f33c806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33d4000c00 tx=0x7f33d4009040 comp rx=0 tx=0).stop 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.513+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 msgr2=0x7f33ec1498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.513+0000 7f33f0a00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33ec1498f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00e800 tx=0x7f33dc00ecc0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 shutdown_connections 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f33c806c8f0 0x7f33c806edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33ec1e0f10 0x7f33ec1e1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f33ec1dd9a0 0x7f33ec1dde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 --2- 172.21.15.16:0/3606889501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33d0005210 0x7f33ec1498f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 >> 172.21.15.16:0/3606889501 conn(0x7f33ec0b6630 msgr2=0x7f33ec145630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:50.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 shutdown_connections 2024-04-26T23:34:50.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.514+0000 7f33f0a00640 1 -- 172.21.15.16:0/3606889501 wait complete. 2024-04-26T23:34:50.536 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-26T23:34:49.807086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252288,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722432,"statfs":{"total":773094113280,"available":772835770368,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771687"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105954+0000","last_change":"2024-04-26T23:34:46.097057+0000","last_active":"2024-04-26T23:34:47.105954+0000","last_peered":"2024-04-26T23:34:47.105954+0000","last_clean":"2024-04-26T23:34:47.105954+0000","last_became_active":"2024-04-26T23:34:46.096589+0000","last_became_peered":"2024-04-26T23:34:46.096589+0000","last_unstale":"2024-04-26T23:34:47.105954+0000","last_undegraded":"2024-04-26T23:34:47.105954+0000","last_fullsized":"2024-04-26T23:34:47.105954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198535+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-26T23:34:47.198535+0000","last_peered":"2024-04-26T23:34:47.198535+0000","last_clean":"2024-04-26T23:34:47.198535+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-26T23:34:47.198535+0000","last_undegraded":"2024-04-26T23:34:47.198535+0000","last_fullsized":"2024-04-26T23:34:47.198535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199433+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-26T23:34:47.199433+0000","last_peered":"2024-04-26T23:34:47.199433+0000","last_clean":"2024-04-26T23:34:47.199433+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-26T23:34:47.199433+0000","last_undegraded":"2024-04-26T23:34:47.199433+0000","last_fullsized":"2024-04-26T23:34:47.199433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193060+0000","last_change":"2024-04-26T23:34:46.102692+0000","last_active":"2024-04-26T23:34:47.193060+0000","last_peered":"2024-04-26T23:34:47.193060+0000","last_clean":"2024-04-26T23:34:47.193060+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-26T23:34:47.193060+0000","last_undegraded":"2024-04-26T23:34:47.193060+0000","last_fullsized":"2024-04-26T23:34:47.193060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105877+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-26T23:34:47.105877+0000","last_peered":"2024-04-26T23:34:47.105877+0000","last_clean":"2024-04-26T23:34:47.105877+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-26T23:34:47.105877+0000","last_undegraded":"2024-04-26T23:34:47.105877+0000","last_fullsized":"2024-04-26T23:34:47.105877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193373+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-26T23:34:47.193373+0000","last_peered":"2024-04-26T23:34:47.193373+0000","last_clean":"2024-04-26T23:34:47.193373+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-26T23:34:47.193373+0000","last_undegraded":"2024-04-26T23:34:47.193373+0000","last_fullsized":"2024-04-26T23:34:47.193373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105307+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-26T23:34:47.105307+0000","last_peered":"2024-04-26T23:34:47.105307+0000","last_clean":"2024-04-26T23:34:47.105307+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-26T23:34:47.105307+0000","last_undegraded":"2024-04-26T23:34:47.105307+0000","last_fullsized":"2024-04-26T23:34:47.105307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198176+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-26T23:34:47.198176+0000","last_peered":"2024-04-26T23:34:47.198176+0000","last_clean":"2024-04-26T23:34:47.198176+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-26T23:34:47.198176+0000","last_undegraded":"2024-04-26T23:34:47.198176+0000","last_fullsized":"2024-04-26T23:34:47.198176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194623+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-26T23:34:47.194623+0000","last_peered":"2024-04-26T23:34:47.194623+0000","last_clean":"2024-04-26T23:34:47.194623+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-26T23:34:47.194623+0000","last_undegraded":"2024-04-26T23:34:47.194623+0000","last_fullsized":"2024-04-26T23:34:47.194623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105626+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-26T23:34:47.105626+0000","last_peered":"2024-04-26T23:34:47.105626+0000","last_clean":"2024-04-26T23:34:47.105626+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-26T23:34:47.105626+0000","last_undegraded":"2024-04-26T23:34:47.105626+0000","last_fullsized":"2024-04-26T23:34:47.105626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105942+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-26T23:34:47.105942+0000","last_peered":"2024-04-26T23:34:47.105942+0000","last_clean":"2024-04-26T23:34:47.105942+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-26T23:34:47.105942+0000","last_undegraded":"2024-04-26T23:34:47.105942+0000","last_fullsized":"2024-04-26T23:34:47.105942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105579+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-26T23:34:47.105579+0000","last_peered":"2024-04-26T23:34:47.105579+0000","last_clean":"2024-04-26T23:34:47.105579+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-26T23:34:47.105579+0000","last_undegraded":"2024-04-26T23:34:47.105579+0000","last_fullsized":"2024-04-26T23:34:47.105579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196258+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-26T23:34:47.196258+0000","last_peered":"2024-04-26T23:34:47.196258+0000","last_clean":"2024-04-26T23:34:47.196258+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-26T23:34:47.196258+0000","last_undegraded":"2024-04-26T23:34:47.196258+0000","last_fullsized":"2024-04-26T23:34:47.196258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195637+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-26T23:34:47.195637+0000","last_peered":"2024-04-26T23:34:47.195637+0000","last_clean":"2024-04-26T23:34:47.195637+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-26T23:34:47.195637+0000","last_undegraded":"2024-04-26T23:34:47.195637+0000","last_fullsized":"2024-04-26T23:34:47.195637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.197849+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-26T23:34:47.197849+0000","last_peered":"2024-04-26T23:34:47.197849+0000","last_clean":"2024-04-26T23:34:47.197849+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-26T23:34:47.197849+0000","last_undegraded":"2024-04-26T23:34:47.197849+0000","last_fullsized":"2024-04-26T23:34:47.197849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072035+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-26T23:34:47.072035+0000","last_peered":"2024-04-26T23:34:47.072035+0000","last_clean":"2024-04-26T23:34:47.072035+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-26T23:34:47.072035+0000","last_undegraded":"2024-04-26T23:34:47.072035+0000","last_fullsized":"2024-04-26T23:34:47.072035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072812+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-26T23:34:47.072812+0000","last_peered":"2024-04-26T23:34:47.072812+0000","last_clean":"2024-04-26T23:34:47.072812+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-26T23:34:47.072812+0000","last_undegraded":"2024-04-26T23:34:47.072812+0000","last_fullsized":"2024-04-26T23:34:47.072812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:37.828024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077980+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-26T23:34:47.077980+0000","last_peered":"2024-04-26T23:34:47.077980+0000","last_clean":"2024-04-26T23:34:47.077980+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-26T23:34:47.077980+0000","last_undegraded":"2024-04-26T23:34:47.077980+0000","last_fullsized":"2024-04-26T23:34:47.077980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072768+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-26T23:34:47.072768+0000","last_peered":"2024-04-26T23:34:47.072768+0000","last_clean":"2024-04-26T23:34:47.072768+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-26T23:34:47.072768+0000","last_undegraded":"2024-04-26T23:34:47.072768+0000","last_fullsized":"2024-04-26T23:34:47.072768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:09.342327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105979+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-26T23:34:47.105979+0000","last_peered":"2024-04-26T23:34:47.105979+0000","last_clean":"2024-04-26T23:34:47.105979+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-26T23:34:47.105979+0000","last_undegraded":"2024-04-26T23:34:47.105979+0000","last_fullsized":"2024-04-26T23:34:47.105979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075980+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-26T23:34:47.075980+0000","last_peered":"2024-04-26T23:34:47.075980+0000","last_clean":"2024-04-26T23:34:47.075980+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-26T23:34:47.075980+0000","last_undegraded":"2024-04-26T23:34:47.075980+0000","last_fullsized":"2024-04-26T23:34:47.075980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192852+0000","last_change":"2024-04-26T23:34:46.096164+0000","last_active":"2024-04-26T23:34:47.192852+0000","last_peered":"2024-04-26T23:34:47.192852+0000","last_clean":"2024-04-26T23:34:47.192852+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-26T23:34:47.192852+0000","last_undegraded":"2024-04-26T23:34:47.192852+0000","last_fullsized":"2024-04-26T23:34:47.192852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198089+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-26T23:34:47.198089+0000","last_peered":"2024-04-26T23:34:47.198089+0000","last_clean":"2024-04-26T23:34:47.198089+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-26T23:34:47.198089+0000","last_undegraded":"2024-04-26T23:34:47.198089+0000","last_fullsized":"2024-04-26T23:34:47.198089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072155+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-26T23:34:47.072155+0000","last_peered":"2024-04-26T23:34:47.072155+0000","last_clean":"2024-04-26T23:34:47.072155+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-26T23:34:47.072155+0000","last_undegraded":"2024-04-26T23:34:47.072155+0000","last_fullsized":"2024-04-26T23:34:47.072155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199062+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-26T23:34:47.199062+0000","last_peered":"2024-04-26T23:34:47.199062+0000","last_clean":"2024-04-26T23:34:47.199062+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-26T23:34:47.199062+0000","last_undegraded":"2024-04-26T23:34:47.199062+0000","last_fullsized":"2024-04-26T23:34:47.199062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194860+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-26T23:34:47.194860+0000","last_peered":"2024-04-26T23:34:47.194860+0000","last_clean":"2024-04-26T23:34:47.194860+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-26T23:34:47.194860+0000","last_undegraded":"2024-04-26T23:34:47.194860+0000","last_fullsized":"2024-04-26T23:34:47.194860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196782+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-26T23:34:47.196782+0000","last_peered":"2024-04-26T23:34:47.196782+0000","last_clean":"2024-04-26T23:34:47.196782+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-26T23:34:47.196782+0000","last_undegraded":"2024-04-26T23:34:47.196782+0000","last_fullsized":"2024-04-26T23:34:47.196782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196512+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-26T23:34:47.196512+0000","last_peered":"2024-04-26T23:34:47.196512+0000","last_clean":"2024-04-26T23:34:47.196512+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-26T23:34:47.196512+0000","last_undegraded":"2024-04-26T23:34:47.196512+0000","last_fullsized":"2024-04-26T23:34:47.196512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198188+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-26T23:34:47.198188+0000","last_peered":"2024-04-26T23:34:47.198188+0000","last_clean":"2024-04-26T23:34:47.198188+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-26T23:34:47.198188+0000","last_undegraded":"2024-04-26T23:34:47.198188+0000","last_fullsized":"2024-04-26T23:34:47.198188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:54.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073240+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-26T23:34:47.073240+0000","last_peered":"2024-04-26T23:34:47.073240+0000","last_clean":"2024-04-26T23:34:47.073240+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-26T23:34:47.073240+0000","last_undegraded":"2024-04-26T23:34:47.073240+0000","last_fullsized":"2024-04-26T23:34:47.073240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:08.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075776+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-26T23:34:47.075776+0000","last_peered":"2024-04-26T23:34:47.075776+0000","last_clean":"2024-04-26T23:34:47.075776+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-26T23:34:47.075776+0000","last_undegraded":"2024-04-26T23:34:47.075776+0000","last_fullsized":"2024-04-26T23:34:47.075776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192796+0000","last_change":"2024-04-26T23:34:46.098997+0000","last_active":"2024-04-26T23:34:47.192796+0000","last_peered":"2024-04-26T23:34:47.192796+0000","last_clean":"2024-04-26T23:34:47.192796+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-26T23:34:47.192796+0000","last_undegraded":"2024-04-26T23:34:47.192796+0000","last_fullsized":"2024-04-26T23:34:47.192796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192954+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-26T23:34:47.192954+0000","last_peered":"2024-04-26T23:34:47.192954+0000","last_clean":"2024-04-26T23:34:47.192954+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-26T23:34:47.192954+0000","last_undegraded":"2024-04-26T23:34:47.192954+0000","last_fullsized":"2024-04-26T23:34:47.192954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198600+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-26T23:34:47.198600+0000","last_peered":"2024-04-26T23:34:47.198600+0000","last_clean":"2024-04-26T23:34:47.198600+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-26T23:34:47.198600+0000","last_undegraded":"2024-04-26T23:34:47.198600+0000","last_fullsized":"2024-04-26T23:34:47.198600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076668+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-26T23:34:47.076668+0000","last_peered":"2024-04-26T23:34:47.076668+0000","last_clean":"2024-04-26T23:34:47.076668+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-26T23:34:47.076668+0000","last_undegraded":"2024-04-26T23:34:47.076668+0000","last_fullsized":"2024-04-26T23:34:47.076668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073206+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-26T23:34:47.073206+0000","last_peered":"2024-04-26T23:34:47.073206+0000","last_clean":"2024-04-26T23:34:47.073206+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-26T23:34:47.073206+0000","last_undegraded":"2024-04-26T23:34:47.073206+0000","last_fullsized":"2024-04-26T23:34:47.073206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195482+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-26T23:34:47.195482+0000","last_peered":"2024-04-26T23:34:47.195482+0000","last_clean":"2024-04-26T23:34:47.195482+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-26T23:34:47.195482+0000","last_undegraded":"2024-04-26T23:34:47.195482+0000","last_fullsized":"2024-04-26T23:34:47.195482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198663+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-26T23:34:47.198663+0000","last_peered":"2024-04-26T23:34:47.198663+0000","last_clean":"2024-04-26T23:34:47.198663+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-26T23:34:47.198663+0000","last_undegraded":"2024-04-26T23:34:47.198663+0000","last_fullsized":"2024-04-26T23:34:47.198663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072344+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-26T23:34:47.072344+0000","last_peered":"2024-04-26T23:34:47.072344+0000","last_clean":"2024-04-26T23:34:47.072344+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-26T23:34:47.072344+0000","last_undegraded":"2024-04-26T23:34:47.072344+0000","last_fullsized":"2024-04-26T23:34:47.072344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076210+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-26T23:34:47.076210+0000","last_peered":"2024-04-26T23:34:47.076210+0000","last_clean":"2024-04-26T23:34:47.076210+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-26T23:34:47.076210+0000","last_undegraded":"2024-04-26T23:34:47.076210+0000","last_fullsized":"2024-04-26T23:34:47.076210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194726+0000","last_change":"2024-04-26T23:34:45.074623+0000","last_active":"2024-04-26T23:34:47.194726+0000","last_peered":"2024-04-26T23:34:47.194726+0000","last_clean":"2024-04-26T23:34:47.194726+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-26T23:34:47.194726+0000","last_undegraded":"2024-04-26T23:34:47.194726+0000","last_fullsized":"2024-04-26T23:34:47.194726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195194+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-26T23:34:47.195194+0000","last_peered":"2024-04-26T23:34:47.195194+0000","last_clean":"2024-04-26T23:34:47.195194+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-26T23:34:47.195194+0000","last_undegraded":"2024-04-26T23:34:47.195194+0000","last_fullsized":"2024-04-26T23:34:47.195194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105702+0000","last_change":"2024-04-26T23:34:45.073763+0000","last_active":"2024-04-26T23:34:47.105702+0000","last_peered":"2024-04-26T23:34:47.105702+0000","last_clean":"2024-04-26T23:34:47.105702+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-26T23:34:47.105702+0000","last_undegraded":"2024-04-26T23:34:47.105702+0000","last_fullsized":"2024-04-26T23:34:47.105702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:07.508274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199289+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-26T23:34:47.199289+0000","last_peered":"2024-04-26T23:34:47.199289+0000","last_clean":"2024-04-26T23:34:47.199289+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-26T23:34:47.199289+0000","last_undegraded":"2024-04-26T23:34:47.199289+0000","last_fullsized":"2024-04-26T23:34:47.199289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077282+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-26T23:34:47.077282+0000","last_peered":"2024-04-26T23:34:47.077282+0000","last_clean":"2024-04-26T23:34:47.077282+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-26T23:34:47.077282+0000","last_undegraded":"2024-04-26T23:34:47.077282+0000","last_fullsized":"2024-04-26T23:34:47.077282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073045+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-26T23:34:47.073045+0000","last_peered":"2024-04-26T23:34:47.073045+0000","last_clean":"2024-04-26T23:34:47.073045+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-26T23:34:47.073045+0000","last_undegraded":"2024-04-26T23:34:47.073045+0000","last_fullsized":"2024-04-26T23:34:47.073045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:03.761817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193193+0000","last_change":"2024-04-26T23:34:45.074276+0000","last_active":"2024-04-26T23:34:47.193193+0000","last_peered":"2024-04-26T23:34:47.193193+0000","last_clean":"2024-04-26T23:34:47.193193+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-26T23:34:47.193193+0000","last_undegraded":"2024-04-26T23:34:47.193193+0000","last_fullsized":"2024-04-26T23:34:47.193193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:33.430917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106164+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-26T23:34:47.106164+0000","last_peered":"2024-04-26T23:34:47.106164+0000","last_clean":"2024-04-26T23:34:47.106164+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-26T23:34:47.106164+0000","last_undegraded":"2024-04-26T23:34:47.106164+0000","last_fullsized":"2024-04-26T23:34:47.106164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077577+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-26T23:34:47.077577+0000","last_peered":"2024-04-26T23:34:47.077577+0000","last_clean":"2024-04-26T23:34:47.077577+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-26T23:34:47.077577+0000","last_undegraded":"2024-04-26T23:34:47.077577+0000","last_fullsized":"2024-04-26T23:34:47.077577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196880+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-26T23:34:47.196880+0000","last_peered":"2024-04-26T23:34:47.196880+0000","last_clean":"2024-04-26T23:34:47.196880+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-26T23:34:47.196880+0000","last_undegraded":"2024-04-26T23:34:47.196880+0000","last_fullsized":"2024-04-26T23:34:47.196880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073359+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-26T23:34:47.073359+0000","last_peered":"2024-04-26T23:34:47.073359+0000","last_clean":"2024-04-26T23:34:47.073359+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-26T23:34:47.073359+0000","last_undegraded":"2024-04-26T23:34:47.073359+0000","last_fullsized":"2024-04-26T23:34:47.073359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:49.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072955+0000","last_change":"2024-04-26T23:34:46.093800+0000","last_active":"2024-04-26T23:34:47.072955+0000","last_peered":"2024-04-26T23:34:47.072955+0000","last_clean":"2024-04-26T23:34:47.072955+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-26T23:34:47.072955+0000","last_undegraded":"2024-04-26T23:34:47.072955+0000","last_fullsized":"2024-04-26T23:34:47.072955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:07.701378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105379+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-26T23:34:47.105379+0000","last_peered":"2024-04-26T23:34:47.105379+0000","last_clean":"2024-04-26T23:34:47.105379+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-26T23:34:47.105379+0000","last_undegraded":"2024-04-26T23:34:47.105379+0000","last_fullsized":"2024-04-26T23:34:47.105379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195048+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-26T23:34:47.195048+0000","last_peered":"2024-04-26T23:34:47.195048+0000","last_clean":"2024-04-26T23:34:47.195048+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-26T23:34:47.195048+0000","last_undegraded":"2024-04-26T23:34:47.195048+0000","last_fullsized":"2024-04-26T23:34:47.195048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:08.523129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076152+0000","last_change":"2024-04-26T23:34:45.072379+0000","last_active":"2024-04-26T23:34:47.076152+0000","last_peered":"2024-04-26T23:34:47.076152+0000","last_clean":"2024-04-26T23:34:47.076152+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-26T23:34:47.076152+0000","last_undegraded":"2024-04-26T23:34:47.076152+0000","last_fullsized":"2024-04-26T23:34:47.076152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072186+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-26T23:34:47.072186+0000","last_peered":"2024-04-26T23:34:47.072186+0000","last_clean":"2024-04-26T23:34:47.072186+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-26T23:34:47.072186+0000","last_undegraded":"2024-04-26T23:34:47.072186+0000","last_fullsized":"2024-04-26T23:34:47.072186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106231+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-26T23:34:47.106231+0000","last_peered":"2024-04-26T23:34:47.106231+0000","last_clean":"2024-04-26T23:34:47.106231+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-26T23:34:47.106231+0000","last_undegraded":"2024-04-26T23:34:47.106231+0000","last_fullsized":"2024-04-26T23:34:47.106231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195501+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-26T23:34:47.195501+0000","last_peered":"2024-04-26T23:34:47.195501+0000","last_clean":"2024-04-26T23:34:47.195501+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-26T23:34:47.195501+0000","last_undegraded":"2024-04-26T23:34:47.195501+0000","last_fullsized":"2024-04-26T23:34:47.195501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076869+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-26T23:34:47.076869+0000","last_peered":"2024-04-26T23:34:47.076869+0000","last_clean":"2024-04-26T23:34:47.076869+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-26T23:34:47.076869+0000","last_undegraded":"2024-04-26T23:34:47.076869+0000","last_fullsized":"2024-04-26T23:34:47.076869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106140+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-26T23:34:47.106140+0000","last_peered":"2024-04-26T23:34:47.106140+0000","last_clean":"2024-04-26T23:34:47.106140+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-26T23:34:47.106140+0000","last_undegraded":"2024-04-26T23:34:47.106140+0000","last_fullsized":"2024-04-26T23:34:47.106140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198925+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-26T23:34:47.198925+0000","last_peered":"2024-04-26T23:34:47.198925+0000","last_clean":"2024-04-26T23:34:47.198925+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-26T23:34:47.198925+0000","last_undegraded":"2024-04-26T23:34:47.198925+0000","last_fullsized":"2024-04-26T23:34:47.198925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105774+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-26T23:34:47.105774+0000","last_peered":"2024-04-26T23:34:47.105774+0000","last_clean":"2024-04-26T23:34:47.105774+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-26T23:34:47.105774+0000","last_undegraded":"2024-04-26T23:34:47.105774+0000","last_fullsized":"2024-04-26T23:34:47.105774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196798+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-26T23:34:47.196798+0000","last_peered":"2024-04-26T23:34:47.196798+0000","last_clean":"2024-04-26T23:34:47.196798+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-26T23:34:47.196798+0000","last_undegraded":"2024-04-26T23:34:47.196798+0000","last_fullsized":"2024-04-26T23:34:47.196798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072553+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-26T23:34:47.072553+0000","last_peered":"2024-04-26T23:34:47.072553+0000","last_clean":"2024-04-26T23:34:47.072553+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-26T23:34:47.072553+0000","last_undegraded":"2024-04-26T23:34:47.072553+0000","last_fullsized":"2024-04-26T23:34:47.072553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:10.277157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192890+0000","last_change":"2024-04-26T23:34:41.212862+0000","last_active":"2024-04-26T23:34:47.192890+0000","last_peered":"2024-04-26T23:34:47.192890+0000","last_clean":"2024-04-26T23:34:47.192890+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-26T23:34:47.192890+0000","last_undegraded":"2024-04-26T23:34:47.192890+0000","last_fullsized":"2024-04-26T23:34:47.192890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_clean_scrub_stamp":"2024-04-26T23:34:39.876770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:44.232023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073259+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-26T23:34:47.073259+0000","last_peered":"2024-04-26T23:34:47.073259+0000","last_clean":"2024-04-26T23:34:47.073259+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-26T23:34:47.073259+0000","last_undegraded":"2024-04-26T23:34:47.073259+0000","last_fullsized":"2024-04-26T23:34:47.073259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:35.809938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076511+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-26T23:34:47.076511+0000","last_peered":"2024-04-26T23:34:47.076511+0000","last_clean":"2024-04-26T23:34:47.076511+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-26T23:34:47.076511+0000","last_undegraded":"2024-04-26T23:34:47.076511+0000","last_fullsized":"2024-04-26T23:34:47.076511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072426+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-26T23:34:47.072426+0000","last_peered":"2024-04-26T23:34:47.072426+0000","last_clean":"2024-04-26T23:34:47.072426+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-26T23:34:47.072426+0000","last_undegraded":"2024-04-26T23:34:47.072426+0000","last_fullsized":"2024-04-26T23:34:47.072426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195191+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-26T23:34:47.195191+0000","last_peered":"2024-04-26T23:34:47.195191+0000","last_clean":"2024-04-26T23:34:47.195191+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-26T23:34:47.195191+0000","last_undegraded":"2024-04-26T23:34:47.195191+0000","last_fullsized":"2024-04-26T23:34:47.195191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075729+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-26T23:34:47.075729+0000","last_peered":"2024-04-26T23:34:47.075729+0000","last_clean":"2024-04-26T23:34:47.075729+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-26T23:34:47.075729+0000","last_undegraded":"2024-04-26T23:34:47.075729+0000","last_fullsized":"2024-04-26T23:34:47.075729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198333+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-26T23:34:47.198333+0000","last_peered":"2024-04-26T23:34:47.198333+0000","last_clean":"2024-04-26T23:34:47.198333+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-26T23:34:47.198333+0000","last_undegraded":"2024-04-26T23:34:47.198333+0000","last_fullsized":"2024-04-26T23:34:47.198333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073439+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-26T23:34:47.073439+0000","last_peered":"2024-04-26T23:34:47.073439+0000","last_clean":"2024-04-26T23:34:47.073439+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-26T23:34:47.073439+0000","last_undegraded":"2024-04-26T23:34:47.073439+0000","last_fullsized":"2024-04-26T23:34:47.073439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:21.723421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105537+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-26T23:34:47.105537+0000","last_peered":"2024-04-26T23:34:47.105537+0000","last_clean":"2024-04-26T23:34:47.105537+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-26T23:34:47.105537+0000","last_undegraded":"2024-04-26T23:34:47.105537+0000","last_fullsized":"2024-04-26T23:34:47.105537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198599+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-26T23:34:47.198599+0000","last_peered":"2024-04-26T23:34:47.198599+0000","last_clean":"2024-04-26T23:34:47.198599+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-26T23:34:47.198599+0000","last_undegraded":"2024-04-26T23:34:47.198599+0000","last_fullsized":"2024-04-26T23:34:47.198599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193652+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-26T23:34:47.193652+0000","last_peered":"2024-04-26T23:34:47.193652+0000","last_clean":"2024-04-26T23:34:47.193652+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-26T23:34:47.193652+0000","last_undegraded":"2024-04-26T23:34:47.193652+0000","last_fullsized":"2024-04-26T23:34:47.193652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072874+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-26T23:34:47.072874+0000","last_peered":"2024-04-26T23:34:47.072874+0000","last_clean":"2024-04-26T23:34:47.072874+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-26T23:34:47.072874+0000","last_undegraded":"2024-04-26T23:34:47.072874+0000","last_fullsized":"2024-04-26T23:34:47.072874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:33.819205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196711+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-26T23:34:47.196711+0000","last_peered":"2024-04-26T23:34:47.196711+0000","last_clean":"2024-04-26T23:34:47.196711+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-26T23:34:47.196711+0000","last_undegraded":"2024-04-26T23:34:47.196711+0000","last_fullsized":"2024-04-26T23:34:47.196711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.103576+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-26T23:34:47.103576+0000","last_peered":"2024-04-26T23:34:47.103576+0000","last_clean":"2024-04-26T23:34:47.103576+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-26T23:34:47.103576+0000","last_undegraded":"2024-04-26T23:34:47.103576+0000","last_fullsized":"2024-04-26T23:34:47.103576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077018+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-26T23:34:47.077018+0000","last_peered":"2024-04-26T23:34:47.077018+0000","last_clean":"2024-04-26T23:34:47.077018+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-26T23:34:47.077018+0000","last_undegraded":"2024-04-26T23:34:47.077018+0000","last_fullsized":"2024-04-26T23:34:47.077018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072779+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-26T23:34:47.072779+0000","last_peered":"2024-04-26T23:34:47.072779+0000","last_clean":"2024-04-26T23:34:47.072779+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-26T23:34:47.072779+0000","last_undegraded":"2024-04-26T23:34:47.072779+0000","last_fullsized":"2024-04-26T23:34:47.072779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:19.687355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076579+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-26T23:34:47.076579+0000","last_peered":"2024-04-26T23:34:47.076579+0000","last_clean":"2024-04-26T23:34:47.076579+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-26T23:34:47.076579+0000","last_undegraded":"2024-04-26T23:34:47.076579+0000","last_fullsized":"2024-04-26T23:34:47.076579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105602+0000","last_change":"2024-04-26T23:34:45.076058+0000","last_active":"2024-04-26T23:34:47.105602+0000","last_peered":"2024-04-26T23:34:47.105602+0000","last_clean":"2024-04-26T23:34:47.105602+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-26T23:34:47.105602+0000","last_undegraded":"2024-04-26T23:34:47.105602+0000","last_fullsized":"2024-04-26T23:34:47.105602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072971+0000","last_change":"2024-04-26T23:34:46.092601+0000","last_active":"2024-04-26T23:34:47.072971+0000","last_peered":"2024-04-26T23:34:47.072971+0000","last_clean":"2024-04-26T23:34:47.072971+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-26T23:34:47.072971+0000","last_undegraded":"2024-04-26T23:34:47.072971+0000","last_fullsized":"2024-04-26T23:34:47.072971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:01.319097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076569+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-26T23:34:47.076569+0000","last_peered":"2024-04-26T23:34:47.076569+0000","last_clean":"2024-04-26T23:34:47.076569+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-26T23:34:47.076569+0000","last_undegraded":"2024-04-26T23:34:47.076569+0000","last_fullsized":"2024-04-26T23:34:47.076569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077738+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-26T23:34:47.077738+0000","last_peered":"2024-04-26T23:34:47.077738+0000","last_clean":"2024-04-26T23:34:47.077738+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-26T23:34:47.077738+0000","last_undegraded":"2024-04-26T23:34:47.077738+0000","last_fullsized":"2024-04-26T23:34:47.077738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196010+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-26T23:34:47.196010+0000","last_peered":"2024-04-26T23:34:47.196010+0000","last_clean":"2024-04-26T23:34:47.196010+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-26T23:34:47.196010+0000","last_undegraded":"2024-04-26T23:34:47.196010+0000","last_fullsized":"2024-04-26T23:34:47.196010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077281+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-26T23:34:47.077281+0000","last_peered":"2024-04-26T23:34:47.077281+0000","last_clean":"2024-04-26T23:34:47.077281+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-26T23:34:47.077281+0000","last_undegraded":"2024-04-26T23:34:47.077281+0000","last_fullsized":"2024-04-26T23:34:47.077281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073024+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-26T23:34:47.073024+0000","last_peered":"2024-04-26T23:34:47.073024+0000","last_clean":"2024-04-26T23:34:47.073024+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-26T23:34:47.073024+0000","last_undegraded":"2024-04-26T23:34:47.073024+0000","last_fullsized":"2024-04-26T23:34:47.073024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:35.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072912+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-26T23:34:47.072912+0000","last_peered":"2024-04-26T23:34:47.072912+0000","last_clean":"2024-04-26T23:34:47.072912+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-26T23:34:47.072912+0000","last_undegraded":"2024-04-26T23:34:47.072912+0000","last_fullsized":"2024-04-26T23:34:47.072912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:37.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072327+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-26T23:34:47.072327+0000","last_peered":"2024-04-26T23:34:47.072327+0000","last_clean":"2024-04-26T23:34:47.072327+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-26T23:34:47.072327+0000","last_undegraded":"2024-04-26T23:34:47.072327+0000","last_fullsized":"2024-04-26T23:34:47.072327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105857+0000","last_change":"2024-04-26T23:34:45.075234+0000","last_active":"2024-04-26T23:34:47.105857+0000","last_peered":"2024-04-26T23:34:47.105857+0000","last_clean":"2024-04-26T23:34:47.105857+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-26T23:34:47.105857+0000","last_undegraded":"2024-04-26T23:34:47.105857+0000","last_fullsized":"2024-04-26T23:34:47.105857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194840+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-26T23:34:47.194840+0000","last_peered":"2024-04-26T23:34:47.194840+0000","last_clean":"2024-04-26T23:34:47.194840+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-26T23:34:47.194840+0000","last_undegraded":"2024-04-26T23:34:47.194840+0000","last_fullsized":"2024-04-26T23:34:47.194840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106263+0000","last_change":"2024-04-26T23:34:45.074596+0000","last_active":"2024-04-26T23:34:47.106263+0000","last_peered":"2024-04-26T23:34:47.106263+0000","last_clean":"2024-04-26T23:34:47.106263+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-26T23:34:47.106263+0000","last_undegraded":"2024-04-26T23:34:47.106263+0000","last_fullsized":"2024-04-26T23:34:47.106263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199369+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-26T23:34:47.199369+0000","last_peered":"2024-04-26T23:34:47.199369+0000","last_clean":"2024-04-26T23:34:47.199369+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-26T23:34:47.199369+0000","last_undegraded":"2024-04-26T23:34:47.199369+0000","last_fullsized":"2024-04-26T23:34:47.199369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199395+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-26T23:34:47.199395+0000","last_peered":"2024-04-26T23:34:47.199395+0000","last_clean":"2024-04-26T23:34:47.199395+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-26T23:34:47.199395+0000","last_undegraded":"2024-04-26T23:34:47.199395+0000","last_fullsized":"2024-04-26T23:34:47.199395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199201+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-26T23:34:47.199201+0000","last_peered":"2024-04-26T23:34:47.199201+0000","last_clean":"2024-04-26T23:34:47.199201+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-26T23:34:47.199201+0000","last_undegraded":"2024-04-26T23:34:47.199201+0000","last_fullsized":"2024-04-26T23:34:47.199201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077353+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-26T23:34:47.077353+0000","last_peered":"2024-04-26T23:34:47.077353+0000","last_clean":"2024-04-26T23:34:47.077353+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-26T23:34:47.077353+0000","last_undegraded":"2024-04-26T23:34:47.077353+0000","last_fullsized":"2024-04-26T23:34:47.077353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":70990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:34:50.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:34:50.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.787+0000 7f90f7200640 1 Processor -- start 2024-04-26T23:34:50.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.788+0000 7f90f7200640 1 -- start start 2024-04-26T23:34:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.789+0000 7f90f7200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f80bbc30 0x7f90f8148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.789+0000 7f90f7200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f90f80bd7a0 0x7f90f80baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.789+0000 7f90f7200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90f80bc010 con 0x7f90f8073420 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.789+0000 7f90f7200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f90f8149220 con 0x7f90f80bd7a0 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.789+0000 7f90f7200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f90f8148220 con 0x7f90f80bbc30 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.789+0000 7f90f6800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f90f8073420 0x7f90f8073cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32818/0 (socket says 172.21.15.16:32818) 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.789+0000 7f90f6800640 1 -- 172.21.15.16:0/1711860886 learned_addr learned my addr 172.21.15.16:0/1711860886 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f5400640 1 --2- 172.21.15.16:0/1711860886 >> v2:172.21.15.32:3300/0 conn(0x7f90f80bd7a0 0x7f90f80baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f5e00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f80bbc30 0x7f90f8148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372040613 0 0) 0x7f90f80bc010 con 0x7f90f8073420 2024-04-26T23:34:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90dc003520 con 0x7f90f8073420 2024-04-26T23:34:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3617743153 0 0) 0x7f90dc003520 con 0x7f90f8073420 2024-04-26T23:34:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f80bbc30 msgr2=0x7f90f8148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f80bbc30 0x7f90f8148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 >> v2:172.21.15.32:3300/0 conn(0x7f90f80bd7a0 msgr2=0x7f90f80baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 --2- 172.21.15.16:0/1711860886 >> v2:172.21.15.32:3300/0 conn(0x7f90f80bd7a0 0x7f90f80baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f81484e0 con 0x7f90f8073420 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f90f00019f0 con 0x7f90f8073420 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 >> v1:172.21.15.16:6789/0 conn(0x7f90f8073420 legacy=0x7f90f8073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90dc0039b0 0x7f90dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc004800 0x7f90dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.790+0000 7f90f4a00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f80bbc30 0x7f90dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8149220 con 0x7f90dc0039b0 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8148220 con 0x7f90dc004800 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f90dc00ba40 con 0x7f90f80bbc30 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f5e00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90dc0039b0 0x7f90dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f5e00640 1 -- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f80bbc30 msgr2=0x7f90dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f5e00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f80bbc30 0x7f90dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f5e00640 1 -- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc004800 msgr2=0x7f90dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f5e00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc004800 0x7f90dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.791+0000 7f90f5e00640 1 -- 172.21.15.16:0/1711860886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc003520 con 0x7f90dc0039b0 2024-04-26T23:34:50.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.792+0000 7f90f5e00640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90dc0039b0 0x7f90dc003dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009ac0 tx=0x7f90dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2037a9004b927e58 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.792+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8036070 con 0x7f90dc0039b0 2024-04-26T23:34:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.792+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e8031400 con 0x7f90dc0039b0 2024-04-26T23:34:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.792+0000 7f90f4a00640 1 -- 172.21.15.16:0/1711860886 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8009690 con 0x7f90dc0039b0 2024-04-26T23:34:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.793+0000 7f90f7200640 1 -- 172.21.15.16:0/1711860886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90dc0039b0 msgr2=0x7f90dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.793+0000 7f90f7200640 1 --2- 172.21.15.16:0/1711860886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90dc0039b0 0x7f90dc003dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009ac0 tx=0x7f90dc005830 comp rx=0 tx=0).stop 2024-04-26T23:34:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.793+0000 7f90f6800640 1 -- 172.21.15.16:0/1711860886 reap_dead start 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.793+0000 7f90f7200640 1 -- 172.21.15.16:0/1711860886 shutdown_connections 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.793+0000 7f90f7200640 1 -- 172.21.15.16:0/1711860886 >> 172.21.15.16:0/1711860886 conn(0x7f90f809fc60 msgr2=0x7f90f80a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.793+0000 7f90f7200640 1 -- 172.21.15.16:0/1711860886 shutdown_connections 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.793+0000 7f90f7200640 1 -- 172.21.15.16:0/1711860886 wait complete. 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.795+0000 7f90f7200640 1 Processor -- start 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.795+0000 7f90f7200640 1 -- start start 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f7200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc0039b0 0x7f90f81e1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f814aee0 0x7f90f81e1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f7200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f81419e0 0x7f90f8141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f7200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8074400 con 0x7f90f814aee0 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f7200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f90f80baf50 con 0x7f90dc0039b0 2024-04-26T23:34:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f7200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f90f8074580 con 0x7f90f81419e0 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f814aee0 0x7f90f81e1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f814aee0 0x7f90f81e1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35156/0 (socket says 172.21.15.16:35156) 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.796+0000 7f90f5400640 1 -- 172.21.15.16:0/3737686658 learned_addr learned my addr 172.21.15.16:0/3737686658 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f6800640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f81419e0 0x7f90f8141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f5400640 1 -- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f81419e0 msgr2=0x7f90f8141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f5e00640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc0039b0 0x7f90f81e1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f5400640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f81419e0 0x7f90f8141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f5400640 1 -- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc0039b0 msgr2=0x7f90f81e1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f5400640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc0039b0 0x7f90f81e1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f5400640 1 -- 172.21.15.16:0/3737686658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f80a10c0 con 0x7f90f814aee0 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f5400640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f814aee0 0x7f90f81e1c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e860 tx=0x7f90e400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90ee000640 1 -- 172.21.15.16:0/3737686658 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4017070 con 0x7f90f814aee0 2024-04-26T23:34:50.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90ee000640 1 -- 172.21.15.16:0/3737686658 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e400c940 con 0x7f90f814aee0 2024-04-26T23:34:50.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f814b8e0 con 0x7f90f814aee0 2024-04-26T23:34:50.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90ee000640 1 -- 172.21.15.16:0/3737686658 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e400cd10 con 0x7f90f814aee0 2024-04-26T23:34:50.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.797+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f814bde0 con 0x7f90f814aee0 2024-04-26T23:34:50.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.798+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f8076600 con 0x7f90f814aee0 2024-04-26T23:34:50.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.800+0000 7f90ee000640 1 -- 172.21.15.16:0/3737686658 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90e401a070 con 0x7f90f814aee0 2024-04-26T23:34:50.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.802+0000 7f90ee000640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d806c8f0 0x7f90d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:50.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.802+0000 7f90ee000640 1 -- 172.21.15.16:0/3737686658 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f90e408baa0 con 0x7f90f814aee0 2024-04-26T23:34:50.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.803+0000 7f90f5e00640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d806c8f0 0x7f90d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:50.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.804+0000 7f90f5e00640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d806c8f0 0x7f90d806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90e8033000 tx=0x7f90e8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:50.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:50.805+0000 7f90ee000640 1 -- 172.21.15.16:0/3737686658 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f90e4059ec0 con 0x7f90f814aee0 2024-04-26T23:34:51.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.006+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90f814bab0 con 0x7f90d806c8f0 2024-04-26T23:34:51.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.026+0000 7f90ee000640 1 -- 172.21.15.16:0/3737686658 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7f90f814bab0 con 0x7f90d806c8f0 2024-04-26T23:34:51.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:51.035 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T23:34:51.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d806c8f0 msgr2=0x7f90d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d806c8f0 0x7f90d806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90e8033000 tx=0x7f90e8008030 comp rx=0 tx=0).stop 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f814aee0 msgr2=0x7f90f81e1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f814aee0 0x7f90f81e1c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e860 tx=0x7f90e400ed20 comp rx=0 tx=0).stop 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 shutdown_connections 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d806c8f0 0x7f90d806edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f81419e0 0x7f90f8141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f814aee0 0x7f90f81e1c60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 --2- 172.21.15.16:0/3737686658 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90dc0039b0 0x7f90f81e1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.031+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 >> 172.21.15.16:0/3737686658 conn(0x7f90f809fc60 msgr2=0x7f90f8146340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.032+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 shutdown_connections 2024-04-26T23:34:51.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.032+0000 7f90f7200640 1 -- 172.21.15.16:0/3737686658 wait complete. 2024-04-26T23:34:51.053 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-26T23:34:49.807086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252288,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722432,"statfs":{"total":773094113280,"available":772835770368,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771687"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105954+0000","last_change":"2024-04-26T23:34:46.097057+0000","last_active":"2024-04-26T23:34:47.105954+0000","last_peered":"2024-04-26T23:34:47.105954+0000","last_clean":"2024-04-26T23:34:47.105954+0000","last_became_active":"2024-04-26T23:34:46.096589+0000","last_became_peered":"2024-04-26T23:34:46.096589+0000","last_unstale":"2024-04-26T23:34:47.105954+0000","last_undegraded":"2024-04-26T23:34:47.105954+0000","last_fullsized":"2024-04-26T23:34:47.105954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198535+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-26T23:34:47.198535+0000","last_peered":"2024-04-26T23:34:47.198535+0000","last_clean":"2024-04-26T23:34:47.198535+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-26T23:34:47.198535+0000","last_undegraded":"2024-04-26T23:34:47.198535+0000","last_fullsized":"2024-04-26T23:34:47.198535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199433+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-26T23:34:47.199433+0000","last_peered":"2024-04-26T23:34:47.199433+0000","last_clean":"2024-04-26T23:34:47.199433+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-26T23:34:47.199433+0000","last_undegraded":"2024-04-26T23:34:47.199433+0000","last_fullsized":"2024-04-26T23:34:47.199433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193060+0000","last_change":"2024-04-26T23:34:46.102692+0000","last_active":"2024-04-26T23:34:47.193060+0000","last_peered":"2024-04-26T23:34:47.193060+0000","last_clean":"2024-04-26T23:34:47.193060+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-26T23:34:47.193060+0000","last_undegraded":"2024-04-26T23:34:47.193060+0000","last_fullsized":"2024-04-26T23:34:47.193060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105877+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-26T23:34:47.105877+0000","last_peered":"2024-04-26T23:34:47.105877+0000","last_clean":"2024-04-26T23:34:47.105877+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-26T23:34:47.105877+0000","last_undegraded":"2024-04-26T23:34:47.105877+0000","last_fullsized":"2024-04-26T23:34:47.105877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193373+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-26T23:34:47.193373+0000","last_peered":"2024-04-26T23:34:47.193373+0000","last_clean":"2024-04-26T23:34:47.193373+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-26T23:34:47.193373+0000","last_undegraded":"2024-04-26T23:34:47.193373+0000","last_fullsized":"2024-04-26T23:34:47.193373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105307+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-26T23:34:47.105307+0000","last_peered":"2024-04-26T23:34:47.105307+0000","last_clean":"2024-04-26T23:34:47.105307+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-26T23:34:47.105307+0000","last_undegraded":"2024-04-26T23:34:47.105307+0000","last_fullsized":"2024-04-26T23:34:47.105307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198176+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-26T23:34:47.198176+0000","last_peered":"2024-04-26T23:34:47.198176+0000","last_clean":"2024-04-26T23:34:47.198176+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-26T23:34:47.198176+0000","last_undegraded":"2024-04-26T23:34:47.198176+0000","last_fullsized":"2024-04-26T23:34:47.198176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194623+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-26T23:34:47.194623+0000","last_peered":"2024-04-26T23:34:47.194623+0000","last_clean":"2024-04-26T23:34:47.194623+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-26T23:34:47.194623+0000","last_undegraded":"2024-04-26T23:34:47.194623+0000","last_fullsized":"2024-04-26T23:34:47.194623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105626+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-26T23:34:47.105626+0000","last_peered":"2024-04-26T23:34:47.105626+0000","last_clean":"2024-04-26T23:34:47.105626+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-26T23:34:47.105626+0000","last_undegraded":"2024-04-26T23:34:47.105626+0000","last_fullsized":"2024-04-26T23:34:47.105626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105942+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-26T23:34:47.105942+0000","last_peered":"2024-04-26T23:34:47.105942+0000","last_clean":"2024-04-26T23:34:47.105942+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-26T23:34:47.105942+0000","last_undegraded":"2024-04-26T23:34:47.105942+0000","last_fullsized":"2024-04-26T23:34:47.105942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105579+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-26T23:34:47.105579+0000","last_peered":"2024-04-26T23:34:47.105579+0000","last_clean":"2024-04-26T23:34:47.105579+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-26T23:34:47.105579+0000","last_undegraded":"2024-04-26T23:34:47.105579+0000","last_fullsized":"2024-04-26T23:34:47.105579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196258+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-26T23:34:47.196258+0000","last_peered":"2024-04-26T23:34:47.196258+0000","last_clean":"2024-04-26T23:34:47.196258+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-26T23:34:47.196258+0000","last_undegraded":"2024-04-26T23:34:47.196258+0000","last_fullsized":"2024-04-26T23:34:47.196258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195637+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-26T23:34:47.195637+0000","last_peered":"2024-04-26T23:34:47.195637+0000","last_clean":"2024-04-26T23:34:47.195637+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-26T23:34:47.195637+0000","last_undegraded":"2024-04-26T23:34:47.195637+0000","last_fullsized":"2024-04-26T23:34:47.195637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.197849+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-26T23:34:47.197849+0000","last_peered":"2024-04-26T23:34:47.197849+0000","last_clean":"2024-04-26T23:34:47.197849+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-26T23:34:47.197849+0000","last_undegraded":"2024-04-26T23:34:47.197849+0000","last_fullsized":"2024-04-26T23:34:47.197849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072035+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-26T23:34:47.072035+0000","last_peered":"2024-04-26T23:34:47.072035+0000","last_clean":"2024-04-26T23:34:47.072035+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-26T23:34:47.072035+0000","last_undegraded":"2024-04-26T23:34:47.072035+0000","last_fullsized":"2024-04-26T23:34:47.072035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072812+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-26T23:34:47.072812+0000","last_peered":"2024-04-26T23:34:47.072812+0000","last_clean":"2024-04-26T23:34:47.072812+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-26T23:34:47.072812+0000","last_undegraded":"2024-04-26T23:34:47.072812+0000","last_fullsized":"2024-04-26T23:34:47.072812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:37.828024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077980+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-26T23:34:47.077980+0000","last_peered":"2024-04-26T23:34:47.077980+0000","last_clean":"2024-04-26T23:34:47.077980+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-26T23:34:47.077980+0000","last_undegraded":"2024-04-26T23:34:47.077980+0000","last_fullsized":"2024-04-26T23:34:47.077980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072768+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-26T23:34:47.072768+0000","last_peered":"2024-04-26T23:34:47.072768+0000","last_clean":"2024-04-26T23:34:47.072768+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-26T23:34:47.072768+0000","last_undegraded":"2024-04-26T23:34:47.072768+0000","last_fullsized":"2024-04-26T23:34:47.072768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:09.342327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105979+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-26T23:34:47.105979+0000","last_peered":"2024-04-26T23:34:47.105979+0000","last_clean":"2024-04-26T23:34:47.105979+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-26T23:34:47.105979+0000","last_undegraded":"2024-04-26T23:34:47.105979+0000","last_fullsized":"2024-04-26T23:34:47.105979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075980+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-26T23:34:47.075980+0000","last_peered":"2024-04-26T23:34:47.075980+0000","last_clean":"2024-04-26T23:34:47.075980+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-26T23:34:47.075980+0000","last_undegraded":"2024-04-26T23:34:47.075980+0000","last_fullsized":"2024-04-26T23:34:47.075980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192852+0000","last_change":"2024-04-26T23:34:46.096164+0000","last_active":"2024-04-26T23:34:47.192852+0000","last_peered":"2024-04-26T23:34:47.192852+0000","last_clean":"2024-04-26T23:34:47.192852+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-26T23:34:47.192852+0000","last_undegraded":"2024-04-26T23:34:47.192852+0000","last_fullsized":"2024-04-26T23:34:47.192852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198089+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-26T23:34:47.198089+0000","last_peered":"2024-04-26T23:34:47.198089+0000","last_clean":"2024-04-26T23:34:47.198089+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-26T23:34:47.198089+0000","last_undegraded":"2024-04-26T23:34:47.198089+0000","last_fullsized":"2024-04-26T23:34:47.198089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072155+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-26T23:34:47.072155+0000","last_peered":"2024-04-26T23:34:47.072155+0000","last_clean":"2024-04-26T23:34:47.072155+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-26T23:34:47.072155+0000","last_undegraded":"2024-04-26T23:34:47.072155+0000","last_fullsized":"2024-04-26T23:34:47.072155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199062+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-26T23:34:47.199062+0000","last_peered":"2024-04-26T23:34:47.199062+0000","last_clean":"2024-04-26T23:34:47.199062+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-26T23:34:47.199062+0000","last_undegraded":"2024-04-26T23:34:47.199062+0000","last_fullsized":"2024-04-26T23:34:47.199062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194860+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-26T23:34:47.194860+0000","last_peered":"2024-04-26T23:34:47.194860+0000","last_clean":"2024-04-26T23:34:47.194860+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-26T23:34:47.194860+0000","last_undegraded":"2024-04-26T23:34:47.194860+0000","last_fullsized":"2024-04-26T23:34:47.194860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196782+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-26T23:34:47.196782+0000","last_peered":"2024-04-26T23:34:47.196782+0000","last_clean":"2024-04-26T23:34:47.196782+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-26T23:34:47.196782+0000","last_undegraded":"2024-04-26T23:34:47.196782+0000","last_fullsized":"2024-04-26T23:34:47.196782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196512+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-26T23:34:47.196512+0000","last_peered":"2024-04-26T23:34:47.196512+0000","last_clean":"2024-04-26T23:34:47.196512+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-26T23:34:47.196512+0000","last_undegraded":"2024-04-26T23:34:47.196512+0000","last_fullsized":"2024-04-26T23:34:47.196512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198188+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-26T23:34:47.198188+0000","last_peered":"2024-04-26T23:34:47.198188+0000","last_clean":"2024-04-26T23:34:47.198188+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-26T23:34:47.198188+0000","last_undegraded":"2024-04-26T23:34:47.198188+0000","last_fullsized":"2024-04-26T23:34:47.198188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:54.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073240+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-26T23:34:47.073240+0000","last_peered":"2024-04-26T23:34:47.073240+0000","last_clean":"2024-04-26T23:34:47.073240+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-26T23:34:47.073240+0000","last_undegraded":"2024-04-26T23:34:47.073240+0000","last_fullsized":"2024-04-26T23:34:47.073240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:08.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075776+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-26T23:34:47.075776+0000","last_peered":"2024-04-26T23:34:47.075776+0000","last_clean":"2024-04-26T23:34:47.075776+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-26T23:34:47.075776+0000","last_undegraded":"2024-04-26T23:34:47.075776+0000","last_fullsized":"2024-04-26T23:34:47.075776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192796+0000","last_change":"2024-04-26T23:34:46.098997+0000","last_active":"2024-04-26T23:34:47.192796+0000","last_peered":"2024-04-26T23:34:47.192796+0000","last_clean":"2024-04-26T23:34:47.192796+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-26T23:34:47.192796+0000","last_undegraded":"2024-04-26T23:34:47.192796+0000","last_fullsized":"2024-04-26T23:34:47.192796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192954+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-26T23:34:47.192954+0000","last_peered":"2024-04-26T23:34:47.192954+0000","last_clean":"2024-04-26T23:34:47.192954+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-26T23:34:47.192954+0000","last_undegraded":"2024-04-26T23:34:47.192954+0000","last_fullsized":"2024-04-26T23:34:47.192954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198600+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-26T23:34:47.198600+0000","last_peered":"2024-04-26T23:34:47.198600+0000","last_clean":"2024-04-26T23:34:47.198600+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-26T23:34:47.198600+0000","last_undegraded":"2024-04-26T23:34:47.198600+0000","last_fullsized":"2024-04-26T23:34:47.198600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076668+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-26T23:34:47.076668+0000","last_peered":"2024-04-26T23:34:47.076668+0000","last_clean":"2024-04-26T23:34:47.076668+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-26T23:34:47.076668+0000","last_undegraded":"2024-04-26T23:34:47.076668+0000","last_fullsized":"2024-04-26T23:34:47.076668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073206+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-26T23:34:47.073206+0000","last_peered":"2024-04-26T23:34:47.073206+0000","last_clean":"2024-04-26T23:34:47.073206+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-26T23:34:47.073206+0000","last_undegraded":"2024-04-26T23:34:47.073206+0000","last_fullsized":"2024-04-26T23:34:47.073206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195482+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-26T23:34:47.195482+0000","last_peered":"2024-04-26T23:34:47.195482+0000","last_clean":"2024-04-26T23:34:47.195482+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-26T23:34:47.195482+0000","last_undegraded":"2024-04-26T23:34:47.195482+0000","last_fullsized":"2024-04-26T23:34:47.195482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198663+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-26T23:34:47.198663+0000","last_peered":"2024-04-26T23:34:47.198663+0000","last_clean":"2024-04-26T23:34:47.198663+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-26T23:34:47.198663+0000","last_undegraded":"2024-04-26T23:34:47.198663+0000","last_fullsized":"2024-04-26T23:34:47.198663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072344+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-26T23:34:47.072344+0000","last_peered":"2024-04-26T23:34:47.072344+0000","last_clean":"2024-04-26T23:34:47.072344+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-26T23:34:47.072344+0000","last_undegraded":"2024-04-26T23:34:47.072344+0000","last_fullsized":"2024-04-26T23:34:47.072344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076210+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-26T23:34:47.076210+0000","last_peered":"2024-04-26T23:34:47.076210+0000","last_clean":"2024-04-26T23:34:47.076210+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-26T23:34:47.076210+0000","last_undegraded":"2024-04-26T23:34:47.076210+0000","last_fullsized":"2024-04-26T23:34:47.076210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194726+0000","last_change":"2024-04-26T23:34:45.074623+0000","last_active":"2024-04-26T23:34:47.194726+0000","last_peered":"2024-04-26T23:34:47.194726+0000","last_clean":"2024-04-26T23:34:47.194726+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-26T23:34:47.194726+0000","last_undegraded":"2024-04-26T23:34:47.194726+0000","last_fullsized":"2024-04-26T23:34:47.194726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195194+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-26T23:34:47.195194+0000","last_peered":"2024-04-26T23:34:47.195194+0000","last_clean":"2024-04-26T23:34:47.195194+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-26T23:34:47.195194+0000","last_undegraded":"2024-04-26T23:34:47.195194+0000","last_fullsized":"2024-04-26T23:34:47.195194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105702+0000","last_change":"2024-04-26T23:34:45.073763+0000","last_active":"2024-04-26T23:34:47.105702+0000","last_peered":"2024-04-26T23:34:47.105702+0000","last_clean":"2024-04-26T23:34:47.105702+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-26T23:34:47.105702+0000","last_undegraded":"2024-04-26T23:34:47.105702+0000","last_fullsized":"2024-04-26T23:34:47.105702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:07.508274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199289+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-26T23:34:47.199289+0000","last_peered":"2024-04-26T23:34:47.199289+0000","last_clean":"2024-04-26T23:34:47.199289+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-26T23:34:47.199289+0000","last_undegraded":"2024-04-26T23:34:47.199289+0000","last_fullsized":"2024-04-26T23:34:47.199289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077282+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-26T23:34:47.077282+0000","last_peered":"2024-04-26T23:34:47.077282+0000","last_clean":"2024-04-26T23:34:47.077282+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-26T23:34:47.077282+0000","last_undegraded":"2024-04-26T23:34:47.077282+0000","last_fullsized":"2024-04-26T23:34:47.077282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073045+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-26T23:34:47.073045+0000","last_peered":"2024-04-26T23:34:47.073045+0000","last_clean":"2024-04-26T23:34:47.073045+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-26T23:34:47.073045+0000","last_undegraded":"2024-04-26T23:34:47.073045+0000","last_fullsized":"2024-04-26T23:34:47.073045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:03.761817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193193+0000","last_change":"2024-04-26T23:34:45.074276+0000","last_active":"2024-04-26T23:34:47.193193+0000","last_peered":"2024-04-26T23:34:47.193193+0000","last_clean":"2024-04-26T23:34:47.193193+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-26T23:34:47.193193+0000","last_undegraded":"2024-04-26T23:34:47.193193+0000","last_fullsized":"2024-04-26T23:34:47.193193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:33.430917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106164+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-26T23:34:47.106164+0000","last_peered":"2024-04-26T23:34:47.106164+0000","last_clean":"2024-04-26T23:34:47.106164+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-26T23:34:47.106164+0000","last_undegraded":"2024-04-26T23:34:47.106164+0000","last_fullsized":"2024-04-26T23:34:47.106164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077577+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-26T23:34:47.077577+0000","last_peered":"2024-04-26T23:34:47.077577+0000","last_clean":"2024-04-26T23:34:47.077577+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-26T23:34:47.077577+0000","last_undegraded":"2024-04-26T23:34:47.077577+0000","last_fullsized":"2024-04-26T23:34:47.077577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196880+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-26T23:34:47.196880+0000","last_peered":"2024-04-26T23:34:47.196880+0000","last_clean":"2024-04-26T23:34:47.196880+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-26T23:34:47.196880+0000","last_undegraded":"2024-04-26T23:34:47.196880+0000","last_fullsized":"2024-04-26T23:34:47.196880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073359+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-26T23:34:47.073359+0000","last_peered":"2024-04-26T23:34:47.073359+0000","last_clean":"2024-04-26T23:34:47.073359+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-26T23:34:47.073359+0000","last_undegraded":"2024-04-26T23:34:47.073359+0000","last_fullsized":"2024-04-26T23:34:47.073359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:49.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072955+0000","last_change":"2024-04-26T23:34:46.093800+0000","last_active":"2024-04-26T23:34:47.072955+0000","last_peered":"2024-04-26T23:34:47.072955+0000","last_clean":"2024-04-26T23:34:47.072955+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-26T23:34:47.072955+0000","last_undegraded":"2024-04-26T23:34:47.072955+0000","last_fullsized":"2024-04-26T23:34:47.072955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:07.701378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105379+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-26T23:34:47.105379+0000","last_peered":"2024-04-26T23:34:47.105379+0000","last_clean":"2024-04-26T23:34:47.105379+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-26T23:34:47.105379+0000","last_undegraded":"2024-04-26T23:34:47.105379+0000","last_fullsized":"2024-04-26T23:34:47.105379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195048+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-26T23:34:47.195048+0000","last_peered":"2024-04-26T23:34:47.195048+0000","last_clean":"2024-04-26T23:34:47.195048+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-26T23:34:47.195048+0000","last_undegraded":"2024-04-26T23:34:47.195048+0000","last_fullsized":"2024-04-26T23:34:47.195048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:08.523129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076152+0000","last_change":"2024-04-26T23:34:45.072379+0000","last_active":"2024-04-26T23:34:47.076152+0000","last_peered":"2024-04-26T23:34:47.076152+0000","last_clean":"2024-04-26T23:34:47.076152+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-26T23:34:47.076152+0000","last_undegraded":"2024-04-26T23:34:47.076152+0000","last_fullsized":"2024-04-26T23:34:47.076152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072186+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-26T23:34:47.072186+0000","last_peered":"2024-04-26T23:34:47.072186+0000","last_clean":"2024-04-26T23:34:47.072186+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-26T23:34:47.072186+0000","last_undegraded":"2024-04-26T23:34:47.072186+0000","last_fullsized":"2024-04-26T23:34:47.072186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106231+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-26T23:34:47.106231+0000","last_peered":"2024-04-26T23:34:47.106231+0000","last_clean":"2024-04-26T23:34:47.106231+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-26T23:34:47.106231+0000","last_undegraded":"2024-04-26T23:34:47.106231+0000","last_fullsized":"2024-04-26T23:34:47.106231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195501+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-26T23:34:47.195501+0000","last_peered":"2024-04-26T23:34:47.195501+0000","last_clean":"2024-04-26T23:34:47.195501+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-26T23:34:47.195501+0000","last_undegraded":"2024-04-26T23:34:47.195501+0000","last_fullsized":"2024-04-26T23:34:47.195501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076869+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-26T23:34:47.076869+0000","last_peered":"2024-04-26T23:34:47.076869+0000","last_clean":"2024-04-26T23:34:47.076869+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-26T23:34:47.076869+0000","last_undegraded":"2024-04-26T23:34:47.076869+0000","last_fullsized":"2024-04-26T23:34:47.076869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106140+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-26T23:34:47.106140+0000","last_peered":"2024-04-26T23:34:47.106140+0000","last_clean":"2024-04-26T23:34:47.106140+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-26T23:34:47.106140+0000","last_undegraded":"2024-04-26T23:34:47.106140+0000","last_fullsized":"2024-04-26T23:34:47.106140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198925+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-26T23:34:47.198925+0000","last_peered":"2024-04-26T23:34:47.198925+0000","last_clean":"2024-04-26T23:34:47.198925+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-26T23:34:47.198925+0000","last_undegraded":"2024-04-26T23:34:47.198925+0000","last_fullsized":"2024-04-26T23:34:47.198925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105774+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-26T23:34:47.105774+0000","last_peered":"2024-04-26T23:34:47.105774+0000","last_clean":"2024-04-26T23:34:47.105774+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-26T23:34:47.105774+0000","last_undegraded":"2024-04-26T23:34:47.105774+0000","last_fullsized":"2024-04-26T23:34:47.105774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196798+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-26T23:34:47.196798+0000","last_peered":"2024-04-26T23:34:47.196798+0000","last_clean":"2024-04-26T23:34:47.196798+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-26T23:34:47.196798+0000","last_undegraded":"2024-04-26T23:34:47.196798+0000","last_fullsized":"2024-04-26T23:34:47.196798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072553+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-26T23:34:47.072553+0000","last_peered":"2024-04-26T23:34:47.072553+0000","last_clean":"2024-04-26T23:34:47.072553+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-26T23:34:47.072553+0000","last_undegraded":"2024-04-26T23:34:47.072553+0000","last_fullsized":"2024-04-26T23:34:47.072553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:10.277157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192890+0000","last_change":"2024-04-26T23:34:41.212862+0000","last_active":"2024-04-26T23:34:47.192890+0000","last_peered":"2024-04-26T23:34:47.192890+0000","last_clean":"2024-04-26T23:34:47.192890+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-26T23:34:47.192890+0000","last_undegraded":"2024-04-26T23:34:47.192890+0000","last_fullsized":"2024-04-26T23:34:47.192890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_clean_scrub_stamp":"2024-04-26T23:34:39.876770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:44.232023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073259+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-26T23:34:47.073259+0000","last_peered":"2024-04-26T23:34:47.073259+0000","last_clean":"2024-04-26T23:34:47.073259+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-26T23:34:47.073259+0000","last_undegraded":"2024-04-26T23:34:47.073259+0000","last_fullsized":"2024-04-26T23:34:47.073259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:35.809938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076511+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-26T23:34:47.076511+0000","last_peered":"2024-04-26T23:34:47.076511+0000","last_clean":"2024-04-26T23:34:47.076511+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-26T23:34:47.076511+0000","last_undegraded":"2024-04-26T23:34:47.076511+0000","last_fullsized":"2024-04-26T23:34:47.076511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072426+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-26T23:34:47.072426+0000","last_peered":"2024-04-26T23:34:47.072426+0000","last_clean":"2024-04-26T23:34:47.072426+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-26T23:34:47.072426+0000","last_undegraded":"2024-04-26T23:34:47.072426+0000","last_fullsized":"2024-04-26T23:34:47.072426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195191+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-26T23:34:47.195191+0000","last_peered":"2024-04-26T23:34:47.195191+0000","last_clean":"2024-04-26T23:34:47.195191+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-26T23:34:47.195191+0000","last_undegraded":"2024-04-26T23:34:47.195191+0000","last_fullsized":"2024-04-26T23:34:47.195191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075729+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-26T23:34:47.075729+0000","last_peered":"2024-04-26T23:34:47.075729+0000","last_clean":"2024-04-26T23:34:47.075729+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-26T23:34:47.075729+0000","last_undegraded":"2024-04-26T23:34:47.075729+0000","last_fullsized":"2024-04-26T23:34:47.075729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198333+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-26T23:34:47.198333+0000","last_peered":"2024-04-26T23:34:47.198333+0000","last_clean":"2024-04-26T23:34:47.198333+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-26T23:34:47.198333+0000","last_undegraded":"2024-04-26T23:34:47.198333+0000","last_fullsized":"2024-04-26T23:34:47.198333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073439+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-26T23:34:47.073439+0000","last_peered":"2024-04-26T23:34:47.073439+0000","last_clean":"2024-04-26T23:34:47.073439+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-26T23:34:47.073439+0000","last_undegraded":"2024-04-26T23:34:47.073439+0000","last_fullsized":"2024-04-26T23:34:47.073439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:21.723421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105537+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-26T23:34:47.105537+0000","last_peered":"2024-04-26T23:34:47.105537+0000","last_clean":"2024-04-26T23:34:47.105537+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-26T23:34:47.105537+0000","last_undegraded":"2024-04-26T23:34:47.105537+0000","last_fullsized":"2024-04-26T23:34:47.105537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198599+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-26T23:34:47.198599+0000","last_peered":"2024-04-26T23:34:47.198599+0000","last_clean":"2024-04-26T23:34:47.198599+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-26T23:34:47.198599+0000","last_undegraded":"2024-04-26T23:34:47.198599+0000","last_fullsized":"2024-04-26T23:34:47.198599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193652+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-26T23:34:47.193652+0000","last_peered":"2024-04-26T23:34:47.193652+0000","last_clean":"2024-04-26T23:34:47.193652+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-26T23:34:47.193652+0000","last_undegraded":"2024-04-26T23:34:47.193652+0000","last_fullsized":"2024-04-26T23:34:47.193652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072874+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-26T23:34:47.072874+0000","last_peered":"2024-04-26T23:34:47.072874+0000","last_clean":"2024-04-26T23:34:47.072874+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-26T23:34:47.072874+0000","last_undegraded":"2024-04-26T23:34:47.072874+0000","last_fullsized":"2024-04-26T23:34:47.072874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:33.819205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196711+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-26T23:34:47.196711+0000","last_peered":"2024-04-26T23:34:47.196711+0000","last_clean":"2024-04-26T23:34:47.196711+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-26T23:34:47.196711+0000","last_undegraded":"2024-04-26T23:34:47.196711+0000","last_fullsized":"2024-04-26T23:34:47.196711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.103576+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-26T23:34:47.103576+0000","last_peered":"2024-04-26T23:34:47.103576+0000","last_clean":"2024-04-26T23:34:47.103576+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-26T23:34:47.103576+0000","last_undegraded":"2024-04-26T23:34:47.103576+0000","last_fullsized":"2024-04-26T23:34:47.103576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077018+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-26T23:34:47.077018+0000","last_peered":"2024-04-26T23:34:47.077018+0000","last_clean":"2024-04-26T23:34:47.077018+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-26T23:34:47.077018+0000","last_undegraded":"2024-04-26T23:34:47.077018+0000","last_fullsized":"2024-04-26T23:34:47.077018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072779+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-26T23:34:47.072779+0000","last_peered":"2024-04-26T23:34:47.072779+0000","last_clean":"2024-04-26T23:34:47.072779+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-26T23:34:47.072779+0000","last_undegraded":"2024-04-26T23:34:47.072779+0000","last_fullsized":"2024-04-26T23:34:47.072779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:19.687355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076579+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-26T23:34:47.076579+0000","last_peered":"2024-04-26T23:34:47.076579+0000","last_clean":"2024-04-26T23:34:47.076579+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-26T23:34:47.076579+0000","last_undegraded":"2024-04-26T23:34:47.076579+0000","last_fullsized":"2024-04-26T23:34:47.076579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105602+0000","last_change":"2024-04-26T23:34:45.076058+0000","last_active":"2024-04-26T23:34:47.105602+0000","last_peered":"2024-04-26T23:34:47.105602+0000","last_clean":"2024-04-26T23:34:47.105602+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-26T23:34:47.105602+0000","last_undegraded":"2024-04-26T23:34:47.105602+0000","last_fullsized":"2024-04-26T23:34:47.105602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072971+0000","last_change":"2024-04-26T23:34:46.092601+0000","last_active":"2024-04-26T23:34:47.072971+0000","last_peered":"2024-04-26T23:34:47.072971+0000","last_clean":"2024-04-26T23:34:47.072971+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-26T23:34:47.072971+0000","last_undegraded":"2024-04-26T23:34:47.072971+0000","last_fullsized":"2024-04-26T23:34:47.072971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:01.319097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076569+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-26T23:34:47.076569+0000","last_peered":"2024-04-26T23:34:47.076569+0000","last_clean":"2024-04-26T23:34:47.076569+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-26T23:34:47.076569+0000","last_undegraded":"2024-04-26T23:34:47.076569+0000","last_fullsized":"2024-04-26T23:34:47.076569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077738+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-26T23:34:47.077738+0000","last_peered":"2024-04-26T23:34:47.077738+0000","last_clean":"2024-04-26T23:34:47.077738+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-26T23:34:47.077738+0000","last_undegraded":"2024-04-26T23:34:47.077738+0000","last_fullsized":"2024-04-26T23:34:47.077738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196010+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-26T23:34:47.196010+0000","last_peered":"2024-04-26T23:34:47.196010+0000","last_clean":"2024-04-26T23:34:47.196010+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-26T23:34:47.196010+0000","last_undegraded":"2024-04-26T23:34:47.196010+0000","last_fullsized":"2024-04-26T23:34:47.196010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077281+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-26T23:34:47.077281+0000","last_peered":"2024-04-26T23:34:47.077281+0000","last_clean":"2024-04-26T23:34:47.077281+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-26T23:34:47.077281+0000","last_undegraded":"2024-04-26T23:34:47.077281+0000","last_fullsized":"2024-04-26T23:34:47.077281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073024+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-26T23:34:47.073024+0000","last_peered":"2024-04-26T23:34:47.073024+0000","last_clean":"2024-04-26T23:34:47.073024+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-26T23:34:47.073024+0000","last_undegraded":"2024-04-26T23:34:47.073024+0000","last_fullsized":"2024-04-26T23:34:47.073024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:35.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072912+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-26T23:34:47.072912+0000","last_peered":"2024-04-26T23:34:47.072912+0000","last_clean":"2024-04-26T23:34:47.072912+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-26T23:34:47.072912+0000","last_undegraded":"2024-04-26T23:34:47.072912+0000","last_fullsized":"2024-04-26T23:34:47.072912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:37.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072327+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-26T23:34:47.072327+0000","last_peered":"2024-04-26T23:34:47.072327+0000","last_clean":"2024-04-26T23:34:47.072327+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-26T23:34:47.072327+0000","last_undegraded":"2024-04-26T23:34:47.072327+0000","last_fullsized":"2024-04-26T23:34:47.072327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105857+0000","last_change":"2024-04-26T23:34:45.075234+0000","last_active":"2024-04-26T23:34:47.105857+0000","last_peered":"2024-04-26T23:34:47.105857+0000","last_clean":"2024-04-26T23:34:47.105857+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-26T23:34:47.105857+0000","last_undegraded":"2024-04-26T23:34:47.105857+0000","last_fullsized":"2024-04-26T23:34:47.105857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194840+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-26T23:34:47.194840+0000","last_peered":"2024-04-26T23:34:47.194840+0000","last_clean":"2024-04-26T23:34:47.194840+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-26T23:34:47.194840+0000","last_undegraded":"2024-04-26T23:34:47.194840+0000","last_fullsized":"2024-04-26T23:34:47.194840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106263+0000","last_change":"2024-04-26T23:34:45.074596+0000","last_active":"2024-04-26T23:34:47.106263+0000","last_peered":"2024-04-26T23:34:47.106263+0000","last_clean":"2024-04-26T23:34:47.106263+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-26T23:34:47.106263+0000","last_undegraded":"2024-04-26T23:34:47.106263+0000","last_fullsized":"2024-04-26T23:34:47.106263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199369+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-26T23:34:47.199369+0000","last_peered":"2024-04-26T23:34:47.199369+0000","last_clean":"2024-04-26T23:34:47.199369+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-26T23:34:47.199369+0000","last_undegraded":"2024-04-26T23:34:47.199369+0000","last_fullsized":"2024-04-26T23:34:47.199369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199395+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-26T23:34:47.199395+0000","last_peered":"2024-04-26T23:34:47.199395+0000","last_clean":"2024-04-26T23:34:47.199395+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-26T23:34:47.199395+0000","last_undegraded":"2024-04-26T23:34:47.199395+0000","last_fullsized":"2024-04-26T23:34:47.199395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199201+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-26T23:34:47.199201+0000","last_peered":"2024-04-26T23:34:47.199201+0000","last_clean":"2024-04-26T23:34:47.199201+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-26T23:34:47.199201+0000","last_undegraded":"2024-04-26T23:34:47.199201+0000","last_fullsized":"2024-04-26T23:34:47.199201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077353+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-26T23:34:47.077353+0000","last_peered":"2024-04-26T23:34:47.077353+0000","last_clean":"2024-04-26T23:34:47.077353+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-26T23:34:47.077353+0000","last_undegraded":"2024-04-26T23:34:47.077353+0000","last_fullsized":"2024-04-26T23:34:47.077353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":70990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:34:51.058 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:34:51.059 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T23:34:51.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T23:34:51.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T23:34:51.059 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T23:34:51.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.307+0000 7fd1d3200640 1 Processor -- start 2024-04-26T23:34:51.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.308+0000 7fd1d3200640 1 -- start start 2024-04-26T23:34:51.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d3200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd1d40bbc30 0x7fd1d4148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d3200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d40bd7a0 0x7fd1d40baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d3200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1d4073420 0x7fd1d4073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d3200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d4149220 con 0x7fd1d4073420 2024-04-26T23:34:51.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d3200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d40bc010 con 0x7fd1d40bbc30 2024-04-26T23:34:51.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d3200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d4148220 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1d4073420 0x7fd1d4073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.309+0000 7fd1d2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1d4073420 0x7fd1d4073cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35166/0 (socket says 172.21.15.16:35166) 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d2800640 1 -- 172.21.15.16:0/3763696900 learned_addr learned my addr 172.21.15.16:0/3763696900 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d1e00640 1 --2- 172.21.15.16:0/3763696900 >> v2:172.21.15.32:3300/0 conn(0x7fd1d40bbc30 0x7fd1d4148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d1400640 1 --2- 172.21.15.16:0/3763696900 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d40bd7a0 0x7fd1d40baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d2800640 1 -- 172.21.15.16:0/3763696900 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d40bd7a0 msgr2=0x7fd1d40baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d2800640 1 --2- 172.21.15.16:0/3763696900 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d40bd7a0 0x7fd1d40baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d2800640 1 -- 172.21.15.16:0/3763696900 >> v2:172.21.15.32:3300/0 conn(0x7fd1d40bbc30 msgr2=0x7fd1d4148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d2800640 1 --2- 172.21.15.16:0/3763696900 >> v2:172.21.15.32:3300/0 conn(0x7fd1d40bbc30 0x7fd1d4148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.310+0000 7fd1d2800640 1 -- 172.21.15.16:0/3763696900 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d41484e0 con 0x7fd1d4073420 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.311+0000 7fd1d2800640 1 --2- 172.21.15.16:0/3763696900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d4073420 0x7fd1d4073cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40bb470 tx=0x7fd1cc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f680770afe10979 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.311+0000 7fd1d0a00640 1 -- 172.21.15.16:0/3763696900 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc037070 con 0x7fd1d4073420 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.311+0000 7fd1d0a00640 1 -- 172.21.15.16:0/3763696900 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc02ae00 con 0x7fd1d4073420 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.311+0000 7fd1d0a00640 1 -- 172.21.15.16:0/3763696900 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc032660 con 0x7fd1d4073420 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.312+0000 7fd1d3200640 1 -- 172.21.15.16:0/3763696900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d4073420 msgr2=0x7fd1d4073cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.312+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3763696900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d4073420 0x7fd1d4073cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40bb470 tx=0x7fd1cc02a0b0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.312+0000 7fd1d3200640 1 -- 172.21.15.16:0/3763696900 shutdown_connections 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.312+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3763696900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d4073420 0x7fd1d4073cf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.312+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3763696900 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d40bd7a0 0x7fd1d40baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.312+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3763696900 >> v2:172.21.15.32:3300/0 conn(0x7fd1d40bbc30 0x7fd1d4148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.312+0000 7fd1d3200640 1 -- 172.21.15.16:0/3763696900 >> 172.21.15.16:0/3763696900 conn(0x7fd1d409fc60 msgr2=0x7fd1d40a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:51.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.313+0000 7fd1d3200640 1 -- 172.21.15.16:0/3763696900 shutdown_connections 2024-04-26T23:34:51.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.313+0000 7fd1d3200640 1 -- 172.21.15.16:0/3763696900 wait complete. 2024-04-26T23:34:51.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.315+0000 7fd1d3200640 1 Processor -- start 2024-04-26T23:34:51.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.315+0000 7fd1d3200640 1 -- start start 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d3200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d4073420 0x7fd1d4142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1d40bbc30 0x7fd1d41449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d3200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d40bd7a0 0x7fd1d4143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d3200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d4074230 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d3200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d40baf50 con 0x7fd1d40bbc30 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d3200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d40743b0 con 0x7fd1d4073420 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d40bd7a0 0x7fd1d4143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d40bd7a0 0x7fd1d4143ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35168/0 (socket says 172.21.15.16:35168) 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d2800640 1 -- 172.21.15.16:0/3129504751 learned_addr learned my addr 172.21.15.16:0/3129504751 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d1e00640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d4073420 0x7fd1d4142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.316+0000 7fd1d1400640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1d40bbc30 0x7fd1d41449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d2800640 1 -- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d4073420 msgr2=0x7fd1d4142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d2800640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d4073420 0x7fd1d4142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d2800640 1 -- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1d40bbc30 msgr2=0x7fd1d41449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d2800640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1d40bbc30 0x7fd1d41449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d2800640 1 -- 172.21.15.16:0/3129504751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d4144f10 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d2800640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d40bd7a0 0x7fd1d4143ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0090b0 tx=0x7fd1cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1ca000640 1 -- 172.21.15.16:0/3129504751 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc042070 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1ca000640 1 -- 172.21.15.16:0/3129504751 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc03e670 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1ca000640 1 -- 172.21.15.16:0/3129504751 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc037040 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d4145da0 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.317+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d40b8170 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.319+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d4076600 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.320+0000 7fd1ca000640 1 -- 172.21.15.16:0/3129504751 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1cc03a040 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.320+0000 7fd1ca000640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1b006c8f0 0x7fd1b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.321+0000 7fd1ca000640 1 -- 172.21.15.16:0/3129504751 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd1cc0aba80 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.321+0000 7fd1d1e00640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1b006c8f0 0x7fd1b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.322+0000 7fd1d1e00640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1b006c8f0 0x7fd1b006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc006fd0 tx=0x7fd1bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:51.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.326+0000 7fd1ca000640 1 -- 172.21.15.16:0/3129504751 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd1d4144f10 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.584+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd1d4143840 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.588+0000 7fd1ca000640 1 -- 172.21.15.16:0/3129504751 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174136 (secure 0 0 0) 0x7fd1cc079f40 con 0x7fd1d40bd7a0 2024-04-26T23:34:51.594 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1b006c8f0 msgr2=0x7fd1b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1b006c8f0 0x7fd1b006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc006fd0 tx=0x7fd1bc008040 comp rx=0 tx=0).stop 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d40bd7a0 msgr2=0x7fd1d4143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d40bd7a0 0x7fd1d4143ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0090b0 tx=0x7fd1cc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 shutdown_connections 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1b006c8f0 0x7fd1b006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1d40bbc30 0x7fd1d41449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1d40bd7a0 0x7fd1d4143ae0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 --2- 172.21.15.16:0/3129504751 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd1d4073420 0x7fd1d4142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 >> 172.21.15.16:0/3129504751 conn(0x7fd1d409fc60 msgr2=0x7fd1d409bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:51.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 shutdown_connections 2024-04-26T23:34:51.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.592+0000 7fd1d3200640 1 -- 172.21.15.16:0/3129504751 wait complete. 2024-04-26T23:34:51.615 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1413279187},{"type":"v1","addr":"172.21.15.32:6833","nonce":1413279187}]},"active_addr":"172.21.15.32:6833/1413279187","active_change":"2024-04-26T23:34:31.787269+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":3389539274}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":3340533767}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":2661683058}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":503353549}]}]} 2024-04-26T23:34:51.619 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T23:34:51.619 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T23:34:51.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:51.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.824+0000 7f255b200640 1 Processor -- start 2024-04-26T23:34:51.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.824+0000 7f255b200640 1 -- start start 2024-04-26T23:34:51.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.826+0000 7f255b200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f255c073600 0x7f255c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.826+0000 7f255b200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c146700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.826+0000 7f255b200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f255c0b6e70 con 0x7f255c0b6a90 2024-04-26T23:34:51.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.826+0000 7f255b200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f255c146c40 con 0x7f255c073600 2024-04-26T23:34:51.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.826+0000 7f255b200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f255c0b3cf0 con 0x7f255c0701e0 2024-04-26T23:34:51.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.826+0000 7f2553e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f255c073600 0x7f255c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.826+0000 7f255a800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.827+0000 7f2559e00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f255c0b6a90 0x7f255c072ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:50476/0 (socket says 172.21.15.16:50476) 2024-04-26T23:34:51.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.827+0000 7f2553e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f255c073600 0x7f255c1461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:54074/0 (socket says 172.21.15.16:54074) 2024-04-26T23:34:51.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.827+0000 7f2553e00640 1 -- 172.21.15.16:0/3919795309 learned_addr learned my addr 172.21.15.16:0/3919795309 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:51.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.827+0000 7f2553e00640 1 -- 172.21.15.16:0/3919795309 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 msgr2=0x7f255c146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:51.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.827+0000 7f2553e00640 1 --2- 172.21.15.16:0/3919795309 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.827+0000 7f2553e00640 1 -- 172.21.15.16:0/3919795309 >> v1:172.21.15.32:6789/0 conn(0x7f255c0b6a90 legacy=0x7f255c072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.827+0000 7f2553e00640 1 -- 172.21.15.16:0/3919795309 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c0b39a0 con 0x7f255c073600 2024-04-26T23:34:51.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.828+0000 7f2553e00640 1 --2- 172.21.15.16:0/3919795309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c073600 0x7f255c1461c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2544009870 tx=0x7f254402a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7282d1138acf27d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.829+0000 7f2559400640 1 -- 172.21.15.16:0/3919795309 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544037070 con 0x7f255c073600 2024-04-26T23:34:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.829+0000 7f2559400640 1 -- 172.21.15.16:0/3919795309 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2544032440 con 0x7f255c073600 2024-04-26T23:34:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.829+0000 7f2559400640 1 -- 172.21.15.16:0/3919795309 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544032810 con 0x7f255c073600 2024-04-26T23:34:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 -- 172.21.15.16:0/3919795309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c073600 msgr2=0x7f255c1461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 --2- 172.21.15.16:0/3919795309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c073600 0x7f255c1461c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2544009870 tx=0x7f254402a140 comp rx=0 tx=0).stop 2024-04-26T23:34:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 -- 172.21.15.16:0/3919795309 shutdown_connections 2024-04-26T23:34:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 --2- 172.21.15.16:0/3919795309 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 --2- 172.21.15.16:0/3919795309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c073600 0x7f255c1461c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 -- 172.21.15.16:0/3919795309 >> 172.21.15.16:0/3919795309 conn(0x7f255c068270 msgr2=0x7f255c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 -- 172.21.15.16:0/3919795309 shutdown_connections 2024-04-26T23:34:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.830+0000 7f255b200640 1 -- 172.21.15.16:0/3919795309 wait complete. 2024-04-26T23:34:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.832+0000 7f255b200640 1 Processor -- start 2024-04-26T23:34:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.833+0000 7f255b200640 1 -- start start 2024-04-26T23:34:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f255b200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f255b200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f255c073600 0x7f255c1ddaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f255b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c0b6a90 0x7f255c0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f255b200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f255c0714b0 con 0x7f255c073600 2024-04-26T23:34:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f255b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f255c073eb0 con 0x7f255c0b6a90 2024-04-26T23:34:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f255b200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f255c070770 con 0x7f255c0701e0 2024-04-26T23:34:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f255c073600 0x7f255c1ddaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f255c073600 0x7f255c1ddaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35174/0 (socket says 172.21.15.16:35174) 2024-04-26T23:34:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 -- 172.21.15.16:0/3003918390 learned_addr learned my addr 172.21.15.16:0/3003918390 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2559e00640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f255a800640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c0b6a90 0x7f255c0b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 -- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 msgr2=0x7f255c0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 -- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c0b6a90 msgr2=0x7f255c0b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c0b6a90 0x7f255c0b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.834+0000 7f2553e00640 1 -- 172.21.15.16:0/3003918390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c1cde20 con 0x7f255c073600 2024-04-26T23:34:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.835+0000 7f2553e00640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f255c073600 0x7f255c1ddaa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2544009990 tx=0x7f25440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.835+0000 7f2552000640 1 -- 172.21.15.16:0/3003918390 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544037040 con 0x7f255c073600 2024-04-26T23:34:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.835+0000 7f2552000640 1 -- 172.21.15.16:0/3003918390 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2544042070 con 0x7f255c073600 2024-04-26T23:34:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.835+0000 7f2552000640 1 -- 172.21.15.16:0/3003918390 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544030920 con 0x7f255c073600 2024-04-26T23:34:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.835+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c1ce370 con 0x7f255c073600 2024-04-26T23:34:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.835+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c1ce090 con 0x7f255c073600 2024-04-26T23:34:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.836+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255c076600 con 0x7f255c073600 2024-04-26T23:34:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.837+0000 7f2552000640 1 -- 172.21.15.16:0/3003918390 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2544030ac0 con 0x7f255c073600 2024-04-26T23:34:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.838+0000 7f2552000640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f253806c8f0 0x7f253806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.838+0000 7f2552000640 1 -- 172.21.15.16:0/3003918390 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f25440ac3b0 con 0x7f255c073600 2024-04-26T23:34:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.839+0000 7f2559e00640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f253806c8f0 0x7f253806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.840+0000 7f2559e00640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f253806c8f0 0x7f253806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f254c000f60 tx=0x7f254c007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:51.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:51.843+0000 7f2552000640 1 -- 172.21.15.16:0/3003918390 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f254407a220 con 0x7f255c073600 2024-04-26T23:34:52.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.050+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f255c1ddfe0 con 0x7f255c073600 2024-04-26T23:34:52.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.053+0000 7f2552000640 1 -- 172.21.15.16:0/3003918390 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16561 (secure 0 0 0) 0x7f254407e520 con 0x7f255c073600 2024-04-26T23:34:52.057 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:52.057 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:47.057746+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f253806c8f0 msgr2=0x7f253806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f253806c8f0 0x7f253806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f254c000f60 tx=0x7f254c007ca0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f255c073600 msgr2=0x7f255c1ddaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f255c073600 0x7f255c1ddaa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2544009990 tx=0x7f25440046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 shutdown_connections 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f253806c8f0 0x7f253806edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f255c0b6a90 0x7f255c0b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f255c073600 0x7f255c1ddaa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 --2- 172.21.15.16:0/3003918390 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f255c0701e0 0x7f255c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.056+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 >> 172.21.15.16:0/3003918390 conn(0x7f255c068270 msgr2=0x7f255c145440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.057+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 shutdown_connections 2024-04-26T23:34:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.057+0000 7f255b200640 1 -- 172.21.15.16:0/3003918390 wait complete. 2024-04-26T23:34:52.079 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T23:34:52.080 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:52.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.285+0000 7f7edc000640 1 Processor -- start 2024-04-26T23:34:52.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.286+0000 7f7edc000640 1 -- start start 2024-04-26T23:34:52.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7edc000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ed406e330 0x7f7ed4073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7edc000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7ed40b37a0 0x7f7ed40b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7edc000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed4140220 0x7f7ed41406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7edc000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed40b1ec0 con 0x7f7ed406e330 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7edc000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed406e710 con 0x7f7ed40b37a0 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7edc000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed40b63d0 con 0x7f7ed4140220 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7ed9600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ed406e330 0x7f7ed4073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7ed9600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ed406e330 0x7f7ed4073860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35188/0 (socket says 172.21.15.16:35188) 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.287+0000 7f7ed9600640 1 -- 172.21.15.16:0/638472523 learned_addr learned my addr 172.21.15.16:0/638472523 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.288+0000 7f7ed9600640 1 -- 172.21.15.16:0/638472523 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed4140220 msgr2=0x7f7ed41406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.288+0000 7f7ed9600640 1 --2- 172.21.15.16:0/638472523 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed4140220 0x7f7ed41406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.288+0000 7f7ed9600640 1 -- 172.21.15.16:0/638472523 >> v2:172.21.15.32:3300/0 conn(0x7f7ed40b37a0 msgr2=0x7f7ed40b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.288+0000 7f7ed9600640 1 --2- 172.21.15.16:0/638472523 >> v2:172.21.15.32:3300/0 conn(0x7f7ed40b37a0 0x7f7ed40b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.288+0000 7f7ed9600640 1 -- 172.21.15.16:0/638472523 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed40b1870 con 0x7f7ed406e330 2024-04-26T23:34:52.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.289+0000 7f7ed9600640 1 --2- 172.21.15.16:0/638472523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed4073860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4147630 tx=0x7f7ec802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ac6509bd8abeb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.289+0000 7f7ed3e00640 1 -- 172.21.15.16:0/638472523 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8037070 con 0x7f7ed406e330 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.289+0000 7f7ed3e00640 1 -- 172.21.15.16:0/638472523 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec8032440 con 0x7f7ed406e330 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.289+0000 7f7ed3e00640 1 -- 172.21.15.16:0/638472523 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8032810 con 0x7f7ed406e330 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 -- 172.21.15.16:0/638472523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 msgr2=0x7f7ed4073860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 --2- 172.21.15.16:0/638472523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed4073860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4147630 tx=0x7f7ec802a140 comp rx=0 tx=0).stop 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 -- 172.21.15.16:0/638472523 shutdown_connections 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 --2- 172.21.15.16:0/638472523 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed4140220 0x7f7ed41406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 --2- 172.21.15.16:0/638472523 >> v2:172.21.15.32:3300/0 conn(0x7f7ed40b37a0 0x7f7ed40b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 --2- 172.21.15.16:0/638472523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed4073860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 -- 172.21.15.16:0/638472523 >> 172.21.15.16:0/638472523 conn(0x7f7ed40b6630 msgr2=0x7f7ed40b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 -- 172.21.15.16:0/638472523 shutdown_connections 2024-04-26T23:34:52.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.290+0000 7f7edc000640 1 -- 172.21.15.16:0/638472523 wait complete. 2024-04-26T23:34:52.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.292+0000 7f7edc000640 1 Processor -- start 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.292+0000 7f7edc000640 1 -- start start 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7edc000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed414a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7edc000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed40b37a0 0x7f7ed40aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7edc000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ed4140220 0x7f7ed40aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7edc000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed4073da0 con 0x7f7ed406e330 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7edc000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed4140bf0 con 0x7f7ed4140220 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7edc000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed40b4530 con 0x7f7ed40b37a0 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7ed9600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed414a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7ed9600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed414a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35200/0 (socket says 172.21.15.16:35200) 2024-04-26T23:34:52.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7ed9600640 1 -- 172.21.15.16:0/2549653216 learned_addr learned my addr 172.21.15.16:0/2549653216 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7ed8c00640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed40b37a0 0x7f7ed40aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.293+0000 7f7eda000640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ed4140220 0x7f7ed40aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed9600640 1 -- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed40b37a0 msgr2=0x7f7ed40aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed9600640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed40b37a0 0x7f7ed40aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed9600640 1 -- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ed4140220 msgr2=0x7f7ed40aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed9600640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ed4140220 0x7f7ed40aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed9600640 1 -- 172.21.15.16:0/2549653216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed4139be0 con 0x7f7ed406e330 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed9600640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed414a060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8000c00 tx=0x7f7ec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed1600640 1 -- 172.21.15.16:0/2549653216 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8041070 con 0x7f7ed406e330 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed1600640 1 -- 172.21.15.16:0/2549653216 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec803c870 con 0x7f7ed406e330 2024-04-26T23:34:52.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed40b0a00 con 0x7f7ed406e330 2024-04-26T23:34:52.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7ed1600640 1 -- 172.21.15.16:0/2549653216 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8037040 con 0x7f7ed406e330 2024-04-26T23:34:52.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.294+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed413b490 con 0x7f7ed406e330 2024-04-26T23:34:52.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.296+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed40693a0 con 0x7f7ed406e330 2024-04-26T23:34:52.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.297+0000 7f7ed1600640 1 -- 172.21.15.16:0/2549653216 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ec8044070 con 0x7f7ed406e330 2024-04-26T23:34:52.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.298+0000 7f7ed1600640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7eb406c920 0x7f7eb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.298+0000 7f7ed1600640 1 -- 172.21.15.16:0/2549653216 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ec80ac730 con 0x7f7ed406e330 2024-04-26T23:34:52.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.298+0000 7f7ed8c00640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7eb406c920 0x7f7eb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.300+0000 7f7ed8c00640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7eb406c920 0x7f7eb406ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ed41326f0 tx=0x7f7ec0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.302+0000 7f7ed1600640 1 -- 172.21.15.16:0/2549653216 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7ed4139be0 con 0x7f7ed406e330 2024-04-26T23:34:52.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.508+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ed40b6ef0 con 0x7f7ed406e330 2024-04-26T23:34:52.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.510+0000 7f7ed1600640 1 -- 172.21.15.16:0/2549653216 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16561 (secure 0 0 0) 0x7f7ec807ad10 con 0x7f7ed406e330 2024-04-26T23:34:52.513 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:52.514 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:47.057746+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:52.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.512+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7eb406c920 msgr2=0x7f7eb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.512+0000 7f7edc000640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7eb406c920 0x7f7eb406ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ed41326f0 tx=0x7f7ec0008040 comp rx=0 tx=0).stop 2024-04-26T23:34:52.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.512+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 msgr2=0x7f7ed414a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.512+0000 7f7edc000640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed414a060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8000c00 tx=0x7f7ec80046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 shutdown_connections 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7eb406c920 0x7f7eb406ede0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ed4140220 0x7f7ed40aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ed40b37a0 0x7f7ed40aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 --2- 172.21.15.16:0/2549653216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ed406e330 0x7f7ed414a060 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 >> 172.21.15.16:0/2549653216 conn(0x7f7ed40b6630 msgr2=0x7f7ed413f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 shutdown_connections 2024-04-26T23:34:52.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.513+0000 7f7edc000640 1 -- 172.21.15.16:0/2549653216 wait complete. 2024-04-26T23:34:52.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T23:34:52.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T23:34:52.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T23:34:52.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T23:34:52.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T23:34:52.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T23:34:52.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T23:34:52.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T23:34:52.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.838+0000 7ff2aa400640 1 Processor -- start 2024-04-26T23:34:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.838+0000 7ff2aa400640 1 -- start start 2024-04-26T23:34:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2aa400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff2a40b6ab0 0x7ff2a41442e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2aa400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2a4144820 0x7ff2a40735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2aa400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a4073b10 0x7ff2a41478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2aa400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff2a40b21a0 con 0x7ff2a4144820 2024-04-26T23:34:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2aa400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7ff2a40b5df0 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2aa400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a40b6e90 con 0x7ff2a4073b10 2024-04-26T23:34:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2a3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2a4144820 0x7ff2a40735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2a3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2a4144820 0x7ff2a40735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35214/0 (socket says 172.21.15.16:35214) 2024-04-26T23:34:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.840+0000 7ff2a3e00640 1 -- 172.21.15.16:0/2338918202 learned_addr learned my addr 172.21.15.16:0/2338918202 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7ff2a9000640 1 --2- 172.21.15.16:0/2338918202 >> v2:172.21.15.32:3300/0 conn(0x7ff2a40b6ab0 0x7ff2a41442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7ff2a9a00640 1 --2- 172.21.15.16:0/2338918202 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a4073b10 0x7ff2a41478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7f7fdd200640 1 Processor -- start 2024-04-26T23:34:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7ff2a3e00640 1 -- 172.21.15.16:0/2338918202 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a4073b10 msgr2=0x7ff2a41478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7ff2a3e00640 1 --2- 172.21.15.16:0/2338918202 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a4073b10 0x7ff2a41478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7ff2a3e00640 1 -- 172.21.15.16:0/2338918202 >> v2:172.21.15.32:3300/0 conn(0x7ff2a40b6ab0 msgr2=0x7ff2a41442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7ff2a3e00640 1 --2- 172.21.15.16:0/2338918202 >> v2:172.21.15.32:3300/0 conn(0x7ff2a40b6ab0 0x7ff2a41442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7ff2a3e00640 1 -- 172.21.15.16:0/2338918202 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a40b1030 con 0x7ff2a4144820 2024-04-26T23:34:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.843+0000 7f0aaa800640 1 Processor -- start 2024-04-26T23:34:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.843+0000 7f0aaa800640 1 -- start start 2024-04-26T23:34:52.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.843+0000 7ff2a3e00640 1 --2- 172.21.15.16:0/2338918202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4144820 0x7ff2a40735d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40b5b40 tx=0x7ff29402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ca46da6cbb0836 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.841+0000 7f7fdd200640 1 -- start start 2024-04-26T23:34:52.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.843+0000 7f7fdd200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd80b54d0 0x7f7fd80b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.843+0000 7f7fdd200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd80b90b0 con 0x7f7fd80b78b0 2024-04-26T23:34:52.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.843+0000 7f7fdd200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd80b9390 con 0x7f7fd80b6c20 2024-04-26T23:34:52.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.843+0000 7f7fdd200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd80b7000 con 0x7f7fd80b54d0 2024-04-26T23:34:52.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7ff2a3400640 1 -- 172.21.15.16:0/2338918202 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294037070 con 0x7ff2a4144820 2024-04-26T23:34:52.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7ff2a3400640 1 -- 172.21.15.16:0/2338918202 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff294032440 con 0x7ff2a4144820 2024-04-26T23:34:52.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7ff2a3400640 1 -- 172.21.15.16:0/2338918202 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294032810 con 0x7ff2a4144820 2024-04-26T23:34:52.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7f0aaa800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa4148100 0x7f0aa41484e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7f0aaa800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0aa40b64e0 0x7f0aa40b6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7f0aaa800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0aa40b4f50 0x7f0aa40b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f0aaa800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0aa40b1610 con 0x7f0aa40b4f50 2024-04-26T23:34:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f0aaa800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f0aa40b49e0 con 0x7f0aa40b64e0 2024-04-26T23:34:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f0aaa800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa4148a20 con 0x7f0aa4148100 2024-04-26T23:34:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7f7fd6800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7fd80b78b0 0x7f7fd80b7d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32822/0 (socket says 172.21.15.16:32822) 2024-04-26T23:34:52.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.844+0000 7f7fd6800640 1 -- 172.21.15.16:0/80458796 learned_addr learned my addr 172.21.15.16:0/80458796 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f0aa2a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0aa40b64e0 0x7f0aa40b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 622435816 0 0) 0x7f7fd80b9390 con 0x7f7fd80b6c20 2024-04-26T23:34:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fbc003520 con 0x7f7fd80b6c20 2024-04-26T23:34:52.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f0aa3400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa4148100 0x7f0aa41484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f0aa3400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa4148100 0x7f0aa41484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56586/0 (socket says 172.21.15.16:56586) 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f0aa3400640 1 -- 172.21.15.16:0/2621137254 learned_addr learned my addr 172.21.15.16:0/2621137254 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.845+0000 7f0aa3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0aa40b4f50 0x7f0aa40b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd5400640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd80b54d0 0x7f7fd80b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 <== mon.1 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4072637027 0 0) 0x7f7fbc003520 con 0x7f7fd80b6c20 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd80b54d0 msgr2=0x7f7fd80b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd80b54d0 0x7f7fd80b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 >> v1:172.21.15.16:6789/0 conn(0x7f7fd80b78b0 legacy=0x7f7fd80b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd80b9670 con 0x7f7fd80b6c20 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 <== mon.1 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f7fc4001670 con 0x7f7fd80b6c20 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 >> v1:172.21.15.32:6789/0 conn(0x7f7fd80b6c20 legacy=0x7f7fd80b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7ff2aa400640 1 -- 172.21.15.16:0/2338918202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4144820 msgr2=0x7ff2a40735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7ff2aa400640 1 --2- 172.21.15.16:0/2338918202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4144820 0x7ff2a40735d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40b5b40 tx=0x7ff29402a1e0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7ff2aa400640 1 -- 172.21.15.16:0/2338918202 shutdown_connections 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7ff2aa400640 1 --2- 172.21.15.16:0/2338918202 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a4073b10 0x7ff2a41478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7ff2aa400640 1 --2- 172.21.15.16:0/2338918202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4144820 0x7ff2a40735d0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40b5b40 tx=0x7ff29402a1e0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7ff2aa400640 1 --2- 172.21.15.16:0/2338918202 >> v2:172.21.15.32:3300/0 conn(0x7ff2a40b6ab0 0x7ff2a41442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7ff2aa400640 1 -- 172.21.15.16:0/2338918202 >> 172.21.15.16:0/2338918202 conn(0x7ff2a4068270 msgr2=0x7ff2a4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.847+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2621137254 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa4148100 msgr2=0x7f0aa41484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.847+0000 7f0aa3e00640 1 --2- 172.21.15.16:0/2621137254 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa4148100 0x7f0aa41484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fbc004800 0x7f7fbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fbc0051c0 0x7f7fbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80b7000 con 0x7f7fbc0039b0 2024-04-26T23:34:52.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.847+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2621137254 >> v2:172.21.15.32:3300/0 conn(0x7f0aa40b64e0 msgr2=0x7f0aa40b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.847+0000 7f0aa3e00640 1 --2- 172.21.15.16:0/2621137254 >> v2:172.21.15.32:3300/0 conn(0x7f0aa40b64e0 0x7f0aa40b6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.847+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2621137254 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa40b3e50 con 0x7f0aa40b4f50 2024-04-26T23:34:52.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc00c090 con 0x7f7fbc004800 2024-04-26T23:34:52.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.846+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc00c240 con 0x7f7fbc0051c0 2024-04-26T23:34:52.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.847+0000 7f7fd5400640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fbc004800 0x7f7fbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.847+0000 7f7fd6800640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fbc0051c0 0x7f7fbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.848+0000 7f7fd5e00640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.848+0000 7ff2aa400640 1 -- 172.21.15.16:0/2338918202 shutdown_connections 2024-04-26T23:34:52.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.848+0000 7f7fd6800640 1 -- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fbc004800 msgr2=0x7f7fbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.848+0000 7f7fd6800640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fbc004800 0x7f7fbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.848+0000 7f7fd6800640 1 -- 172.21.15.16:0/80458796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0039b0 msgr2=0x7f7fbc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.848+0000 7f7fd6800640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.849+0000 7ff2aa400640 1 -- 172.21.15.16:0/2338918202 wait complete. 2024-04-26T23:34:52.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.849+0000 7f7fd6800640 1 -- 172.21.15.16:0/80458796 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd80b9670 con 0x7f7fbc0051c0 2024-04-26T23:34:52.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.849+0000 7f7fd5e00640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0039b0 0x7f7fbc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.850+0000 7f0aa3e00640 1 --2- 172.21.15.16:0/2621137254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aa40b4f50 0x7f0aa40b53c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0aa406cfb0 tx=0x7f0a9c02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67acb9c15afd2760 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.850+0000 7f0aa2000640 1 -- 172.21.15.16:0/2621137254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c007740 con 0x7f0aa40b4f50 2024-04-26T23:34:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.850+0000 7f0aa2000640 1 -- 172.21.15.16:0/2621137254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0078e0 con 0x7f0aa40b4f50 2024-04-26T23:34:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.850+0000 7f0aa2000640 1 -- 172.21.15.16:0/2621137254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c007cb0 con 0x7f0aa40b4f50 2024-04-26T23:34:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.851+0000 7ff2aa400640 1 Processor -- start 2024-04-26T23:34:52.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.851+0000 7f7fd6800640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fbc0051c0 0x7f7fbc00b9c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8001810 tx=0x7f7fbc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=886659cacd8aeb7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.851+0000 7ff2aa400640 1 -- start start 2024-04-26T23:34:52.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.851+0000 7f0aaa800640 1 -- 172.21.15.16:0/2621137254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aa40b4f50 msgr2=0x7f0aa40b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.851+0000 7f0aaa800640 1 --2- 172.21.15.16:0/2621137254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aa40b4f50 0x7f0aa40b53c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0aa406cfb0 tx=0x7f0a9c02a570 comp rx=0 tx=0).stop 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f0aaa800640 1 -- 172.21.15.16:0/2621137254 shutdown_connections 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f0aaa800640 1 --2- 172.21.15.16:0/2621137254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aa40b4f50 0x7f0aa40b53c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f0aaa800640 1 --2- 172.21.15.16:0/2621137254 >> v2:172.21.15.32:3300/0 conn(0x7f0aa40b64e0 0x7f0aa40b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f0aaa800640 1 --2- 172.21.15.16:0/2621137254 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa4148100 0x7f0aa41484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f0aaa800640 1 -- 172.21.15.16:0/2621137254 >> 172.21.15.16:0/2621137254 conn(0x7f0aa406e2b0 msgr2=0x7f0aa406e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f3562200640 1 Processor -- start 2024-04-26T23:34:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f3562200640 1 -- start start 2024-04-26T23:34:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8001460 con 0x7f7fbc0051c0 2024-04-26T23:34:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f7fd4a00640 1 -- 172.21.15.16:0/80458796 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc802e070 con 0x7f7fbc0051c0 2024-04-26T23:34:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.853+0000 7ff2aa400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4073b10 0x7ff2a41de350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7ff2aa400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2a40b6ab0 0x7ff2a41db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f7fdd200640 1 -- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fbc0051c0 msgr2=0x7f7fbc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f7fdd200640 1 --2- 172.21.15.16:0/80458796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fbc0051c0 0x7f7fbc00b9c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8001810 tx=0x7f7fbc005830 comp rx=0 tx=0).stop 2024-04-26T23:34:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f3562200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c0ba400 0x7f355c141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f3562200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f355c142530 0x7f355c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f3562200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355c0beb00 con 0x7f355c0be720 2024-04-26T23:34:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f3562200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f355c14c170 con 0x7f355c142530 2024-04-26T23:34:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f3562200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f355c0b6460 con 0x7f355c0ba400 2024-04-26T23:34:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f0aaa800640 1 -- 172.21.15.16:0/2621137254 shutdown_connections 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.852+0000 7f0aaa800640 1 -- 172.21.15.16:0/2621137254 wait complete. 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f0aaa800640 1 Processor -- start 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7f0aaa800640 1 -- start start 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7ff2aa400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a41dbbe0 0x7ff2a4133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7ff2aa400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a40b15e0 con 0x7ff2a4073b10 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7ff2aa400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a40b1310 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7ff2aa400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a40b2650 con 0x7ff2a41dbbe0 2024-04-26T23:34:52.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f7fd6800640 1 -- 172.21.15.16:0/80458796 reap_dead start 2024-04-26T23:34:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f7fdd200640 1 -- 172.21.15.16:0/80458796 shutdown_connections 2024-04-26T23:34:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f7fdd200640 1 -- 172.21.15.16:0/80458796 >> 172.21.15.16:0/80458796 conn(0x7f7fd806d4a0 msgr2=0x7f7fd806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f355b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f355c0be720 0x7f355c14ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32832/0 (socket says 172.21.15.16:32832) 2024-04-26T23:34:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.854+0000 7f355b400640 1 -- 172.21.15.16:0/1603634579 learned_addr learned my addr 172.21.15.16:0/1603634579 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7f355aa00640 1 --2- 172.21.15.16:0/1603634579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c0ba400 0x7f355c141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7ff2a9a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a41dbbe0 0x7ff2a4133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7ff2a9a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a41dbbe0 0x7ff2a4133690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56596/0 (socket says 172.21.15.16:56596) 2024-04-26T23:34:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7ff2a9a00640 1 -- 172.21.15.16:0/1213747523 learned_addr learned my addr 172.21.15.16:0/1213747523 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7ff2a9000640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4073b10 0x7ff2a41de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7ff374200640 1 Processor -- start 2024-04-26T23:34:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7f355be00640 1 --2- 172.21.15.16:0/1603634579 >> v2:172.21.15.16:3300/0 conn(0x7f355c142530 0x7f355c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.855+0000 7f7fdd200640 1 -- 172.21.15.16:0/80458796 shutdown_connections 2024-04-26T23:34:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7ff2a3e00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2a40b6ab0 0x7ff2a41db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7f7fdd200640 1 -- 172.21.15.16:0/80458796 wait complete. 2024-04-26T23:34:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7f355a000640 1 -- 172.21.15.16:0/1603634579 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297872529 0 0) 0x7f355c0beb00 con 0x7f355c0be720 2024-04-26T23:34:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7f0aaa800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa40b4f50 0x7f0aa409cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7f0aaa800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aa40b64e0 0x7f0aa409ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7f355aa00640 1 -- 172.21.15.16:0/1603634579 >> v2:172.21.15.16:3300/0 conn(0x7f355c142530 msgr2=0x7f355c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7f355aa00640 1 --2- 172.21.15.16:0/1603634579 >> v2:172.21.15.16:3300/0 conn(0x7f355c142530 0x7f355c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7f355aa00640 1 -- 172.21.15.16:0/1603634579 >> v1:172.21.15.16:6789/0 conn(0x7f355c0be720 legacy=0x7f355c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7f355aa00640 1 -- 172.21.15.16:0/1603634579 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c0b59f0 con 0x7f355c0ba400 2024-04-26T23:34:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7f0aaa800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aa4148100 0x7f0aa409bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7f0aaa800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa40b7000 con 0x7f0aa40b64e0 2024-04-26T23:34:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7f0aaa800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa40b6e80 con 0x7f0aa4148100 2024-04-26T23:34:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7f0aaa800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa40b9530 con 0x7f0aa40b4f50 2024-04-26T23:34:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff2a3e00640 1 -- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a41dbbe0 msgr2=0x7ff2a4133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff2a3e00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff2a41dbbe0 0x7ff2a4133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff2a3e00640 1 -- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4073b10 msgr2=0x7ff2a41de350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff2a3e00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a4073b10 0x7ff2a41de350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff2a3e00640 1 -- 172.21.15.16:0/1213747523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a4139d70 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.856+0000 7ff374200640 1 -- start start 2024-04-26T23:34:52.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff374200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff36c0ba400 0x7ff36c141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff374200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff36c142530 0x7ff36c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff374200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36c0beb00 con 0x7ff36c0be720 2024-04-26T23:34:52.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff374200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff36c14c170 con 0x7ff36c0ba400 2024-04-26T23:34:52.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.857+0000 7ff374200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7ff36c0b6460 con 0x7ff36c142530 2024-04-26T23:34:52.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7ff2a3e00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2a40b6ab0 0x7ff2a41db0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40baa50 tx=0x7ff2940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7f0aa3400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa40b4f50 0x7f0aa409cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7ff370e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff36c0ba400 0x7ff36c141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7ff370e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff36c0ba400 0x7ff36c141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35264/0 (socket says 172.21.15.16:35264) 2024-04-26T23:34:52.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7ff370e00640 1 -- 172.21.15.16:0/3088485246 learned_addr learned my addr 172.21.15.16:0/3088485246 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7f0aa3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aa4148100 0x7f0aa409bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7f0aa3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aa4148100 0x7f0aa409bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:54152/0 (socket says 172.21.15.16:54152) 2024-04-26T23:34:52.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2226591351 learned_addr learned my addr 172.21.15.16:0/2226591351 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7f355aa00640 1 --2- 172.21.15.16:0/1603634579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c0ba400 0x7f355c141ff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35480097a0 tx=0x7f354802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec7d94ca9faac44 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7ff372200640 1 --2- 172.21.15.16:0/3088485246 >> v2:172.21.15.32:3300/0 conn(0x7ff36c142530 0x7ff36c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa40b4f50 msgr2=0x7f0aa409cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7f0aa3e00640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0aa40b4f50 0x7f0aa409cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2226591351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aa40b64e0 msgr2=0x7f0aa409ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7f0aa3e00640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aa40b64e0 0x7f0aa409ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7f1846c00640 1 Processor -- start 2024-04-26T23:34:52.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294037040 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff294004230 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294003610 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a413d0b0 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.858+0000 7f7fdd200640 1 Processor -- start 2024-04-26T23:34:52.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7f7fdd200640 1 -- start start 2024-04-26T23:34:52.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7ff370e00640 1 -- 172.21.15.16:0/3088485246 >> v2:172.21.15.32:3300/0 conn(0x7ff36c142530 msgr2=0x7ff36c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7ff370e00640 1 --2- 172.21.15.16:0/3088485246 >> v2:172.21.15.32:3300/0 conn(0x7ff36c142530 0x7ff36c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2226591351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa409e870 con 0x7f0aa4148100 2024-04-26T23:34:52.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7ff370e00640 1 -- 172.21.15.16:0/3088485246 >> v1:172.21.15.16:6789/0 conn(0x7ff36c0be720 legacy=0x7ff36c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7f355a000640 1 -- 172.21.15.16:0/1603634579 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548037070 con 0x7f355c0ba400 2024-04-26T23:34:52.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7f355a000640 1 -- 172.21.15.16:0/1603634579 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3548032440 con 0x7f355c0ba400 2024-04-26T23:34:52.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7f355a000640 1 -- 172.21.15.16:0/1603634579 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548032810 con 0x7f355c0ba400 2024-04-26T23:34:52.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a4072f60 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7ff370e00640 1 -- 172.21.15.16:0/3088485246 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c0b59f0 con 0x7ff36c0ba400 2024-04-26T23:34:52.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7f7fdd200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0051c0 0x7f7fd8147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7f7fdd200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fd8149310 0x7f7fd8148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7f7fdd200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd809ec80 0x7f7fd809f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f3562200640 1 -- 172.21.15.16:0/1603634579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c0ba400 msgr2=0x7f355c141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f3562200640 1 --2- 172.21.15.16:0/1603634579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c0ba400 0x7f355c141ff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35480097a0 tx=0x7f354802a180 comp rx=0 tx=0).stop 2024-04-26T23:34:52.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fdd200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80b45b0 con 0x7f7fbc0051c0 2024-04-26T23:34:52.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.859+0000 7ff36be00640 1 -- 172.21.15.16:0/3088485246 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151240673 0 0) 0x7ff36c0beb00 con 0x7ff36c0be720 2024-04-26T23:34:52.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fdd200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80b4430 con 0x7f7fd8149310 2024-04-26T23:34:52.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fdd200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd80b4730 con 0x7f7fd809ec80 2024-04-26T23:34:52.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.860+0000 7f1846c00640 1 -- start start 2024-04-26T23:34:52.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fd6800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd809ec80 0x7f7fd809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fd5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0051c0 0x7f7fd8147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fd5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0051c0 0x7f7fd8147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35270/0 (socket says 172.21.15.16:35270) 2024-04-26T23:34:52.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fd5e00640 1 -- 172.21.15.16:0/1496748518 learned_addr learned my addr 172.21.15.16:0/1496748518 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f7fd6800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd809ec80 0x7f7fd809f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56626/0 (socket says 172.21.15.16:56626) 2024-04-26T23:34:52.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f3562200640 1 -- 172.21.15.16:0/1603634579 shutdown_connections 2024-04-26T23:34:52.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f3562200640 1 --2- 172.21.15.16:0/1603634579 >> v2:172.21.15.16:3300/0 conn(0x7f355c142530 0x7f355c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f3562200640 1 --2- 172.21.15.16:0/1603634579 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c0ba400 0x7f355c141ff0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f3562200640 1 -- 172.21.15.16:0/1603634579 >> 172.21.15.16:0/1603634579 conn(0x7f355c0686c0 msgr2=0x7f355c0bdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f0aa3e00640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aa4148100 0x7f0aa409bf60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009d90 tx=0x7f0a9c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2a413ae40 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f1846c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18400bb000 0x7f1840148560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f1846c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1840150e30 0x7f1840153220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f1846c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18400b4d00 con 0x7f18400b69c0 2024-04-26T23:34:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f1846c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f18400b5370 con 0x7f1840150e30 2024-04-26T23:34:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.861+0000 7f1846c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f18400bb3e0 con 0x7f18400bb000 2024-04-26T23:34:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f3562200640 1 -- 172.21.15.16:0/1603634579 shutdown_connections 2024-04-26T23:34:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c040070 con 0x7f0aa4148100 2024-04-26T23:34:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c031b40 con 0x7f0aa4148100 2024-04-26T23:34:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c03c420 con 0x7f0aa4148100 2024-04-26T23:34:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa406e720 con 0x7f0aa4148100 2024-04-26T23:34:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f7fd6800640 1 -- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fd8149310 msgr2=0x7f7fd8148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f7fd6800640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7fd8149310 0x7f7fd8148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f7fd6800640 1 -- 172.21.15.16:0/1496748518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0051c0 msgr2=0x7f7fd8147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f7fd6800640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fbc0051c0 0x7f7fd8147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f7fd6800640 1 -- 172.21.15.16:0/1496748518 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd814a200 con 0x7f7fd809ec80 2024-04-26T23:34:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7ff370e00640 1 --2- 172.21.15.16:0/3088485246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 0x7ff36c141ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0beda0 tx=0x7ff36002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd140997e8b86a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f1844c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1840150e30 0x7f1840153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f1844c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1840150e30 0x7f1840153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35276/0 (socket says 172.21.15.16:35276) 2024-04-26T23:34:52.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f1844c00640 1 -- 172.21.15.16:0/3559393443 learned_addr learned my addr 172.21.15.16:0/3559393443 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7ff36be00640 1 -- 172.21.15.16:0/3088485246 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360036070 con 0x7ff36c0ba400 2024-04-26T23:34:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7ff36be00640 1 -- 172.21.15.16:0/3088485246 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff360031600 con 0x7ff36c0ba400 2024-04-26T23:34:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7ff36be00640 1 -- 172.21.15.16:0/3088485246 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360031a10 con 0x7ff36c0ba400 2024-04-26T23:34:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa409efe0 con 0x7f0aa4148100 2024-04-26T23:34:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7f7fd6800640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd809ec80 0x7f7fd809f100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c410 tx=0x7f7fc8001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.864+0000 7ff374200640 1 -- 172.21.15.16:0/3088485246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 msgr2=0x7ff36c141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.864+0000 7ff374200640 1 --2- 172.21.15.16:0/3088485246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 0x7ff36c141ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0beda0 tx=0x7ff36002a760 comp rx=0 tx=0).stop 2024-04-26T23:34:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7f183fe00640 1 --2- 172.21.15.16:0/3559393443 >> v2:172.21.15.32:3300/0 conn(0x7f18400bb000 0x7f1840148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7f1844c00640 1 -- 172.21.15.16:0/3559393443 >> v2:172.21.15.32:3300/0 conn(0x7f18400bb000 msgr2=0x7f1840148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7f1844c00640 1 --2- 172.21.15.16:0/3559393443 >> v2:172.21.15.32:3300/0 conn(0x7f18400bb000 0x7f1840148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7f1844c00640 1 -- 172.21.15.16:0/3559393443 >> v1:172.21.15.32:6789/0 conn(0x7f18400b69c0 legacy=0x7f1840142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7f1844c00640 1 -- 172.21.15.16:0/3559393443 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18400b4a20 con 0x7f1840150e30 2024-04-26T23:34:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.864+0000 7fb32ee00640 1 Processor -- start 2024-04-26T23:34:52.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.863+0000 7fcfdf800640 1 Processor -- start 2024-04-26T23:34:52.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.864+0000 7fcfdf800640 1 -- start start 2024-04-26T23:34:52.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7fb32ee00640 1 -- start start 2024-04-26T23:34:52.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.864+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0aa409e340 con 0x7f0aa4148100 2024-04-26T23:34:52.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8043070 con 0x7f7fd809ec80 2024-04-26T23:34:52.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8007070 con 0x7f7fd809ec80 2024-04-26T23:34:52.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8007440 con 0x7f7fd809ec80 2024-04-26T23:34:52.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.862+0000 7f3562200640 1 -- 172.21.15.16:0/1603634579 wait complete. 2024-04-26T23:34:52.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.864+0000 7f3562200640 1 Processor -- start 2024-04-26T23:34:52.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd8148ac0 con 0x7f7fd809ec80 2024-04-26T23:34:52.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd8147840 con 0x7f7fd809ec80 2024-04-26T23:34:52.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7f3562200640 1 -- start start 2024-04-26T23:34:52.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7fcfdf800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcfd80b64e0 0x7fcfd80b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7fcfdf800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd8144920 0x7fcfd8144d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7fcfdf800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd80b49e0 con 0x7fcfd8148100 2024-04-26T23:34:52.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7fcfdf800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcfd80b1610 con 0x7fcfd80b64e0 2024-04-26T23:34:52.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7fcfdf800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd80b3e50 con 0x7fcfd8144920 2024-04-26T23:34:52.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.865+0000 7f1844c00640 1 --2- 172.21.15.16:0/3559393443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1840150e30 0x7f1840153220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18400b9fc0 tx=0x7f183802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889e5e6388168af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7f183ea00640 1 -- 172.21.15.16:0/3559393443 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838036070 con 0x7f1840150e30 2024-04-26T23:34:52.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7f183ea00640 1 -- 172.21.15.16:0/3559393443 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1838031600 con 0x7f1840150e30 2024-04-26T23:34:52.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7f183ea00640 1 -- 172.21.15.16:0/3559393443 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380319d0 con 0x7f1840150e30 2024-04-26T23:34:52.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7fb32ee00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb3280be720 0x7fb32814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7fb32ee00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb3280ba400 0x7fb328141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7fb32ee00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb328142530 0x7fb3280b8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2940037b0 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7fb32ee00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb3280b6460 con 0x7fb3280ba400 2024-04-26T23:34:52.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7fb32ee00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fb3280b7e10 con 0x7fb328142530 2024-04-26T23:34:52.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7fb32ee00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fb3280beb00 con 0x7fb3280be720 2024-04-26T23:34:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7fd80693a0 con 0x7f7fd809ec80 2024-04-26T23:34:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f1846c00640 1 -- 172.21.15.16:0/3559393443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1840150e30 msgr2=0x7f1840153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f1846c00640 1 --2- 172.21.15.16:0/3559393443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1840150e30 0x7f1840153220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18400b9fc0 tx=0x7f183802a5d0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.866+0000 7fb31fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb3280ba400 0x7fb328141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fb31fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb3280ba400 0x7fb328141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35284/0 (socket says 172.21.15.16:35284) 2024-04-26T23:34:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fb31fe00640 1 -- 172.21.15.16:0/581097041 learned_addr learned my addr 172.21.15.16:0/581097041 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fb327e00640 1 --2- 172.21.15.16:0/581097041 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb3280be720 0x7fb32814ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fcfdce00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcfd8148100 0x7fcfd81484e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32852/0 (socket says 172.21.15.16:32852) 2024-04-26T23:34:52.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fcfdce00640 1 -- 172.21.15.16:0/466207736 learned_addr learned my addr 172.21.15.16:0/466207736 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:52.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fcfdd800640 1 --2- 172.21.15.16:0/466207736 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd8144920 0x7fcfd8144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fcfd7e00640 1 --2- 172.21.15.16:0/466207736 >> v2:172.21.15.16:3300/0 conn(0x7fcfd80b64e0 0x7fcfd80b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7fb32ce00640 1 --2- 172.21.15.16:0/581097041 >> v2:172.21.15.32:3300/0 conn(0x7fb328142530 0x7fb3280b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f1846c00640 1 -- 172.21.15.16:0/3559393443 shutdown_connections 2024-04-26T23:34:52.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f1846c00640 1 --2- 172.21.15.16:0/3559393443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1840150e30 0x7f1840153220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f1846c00640 1 --2- 172.21.15.16:0/3559393443 >> v2:172.21.15.32:3300/0 conn(0x7f18400bb000 0x7f1840148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f1846c00640 1 -- 172.21.15.16:0/3559393443 >> 172.21.15.16:0/3559393443 conn(0x7f18400684b0 msgr2=0x7f18400688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fb31fe00640 1 -- 172.21.15.16:0/581097041 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb3280be720 msgr2=0x7fb32814ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff2a0c00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff28406c940 0x7ff28406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7f1846c00640 1 -- 172.21.15.16:0/3559393443 shutdown_connections 2024-04-26T23:34:52.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7f1846c00640 1 -- 172.21.15.16:0/3559393443 wait complete. 2024-04-26T23:34:52.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2940acef0 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fb31fe00640 1 --2- 172.21.15.16:0/581097041 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb3280be720 0x7fb32814ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fb31fe00640 1 -- 172.21.15.16:0/581097041 >> v2:172.21.15.32:3300/0 conn(0x7fb328142530 msgr2=0x7fb3280b8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fb31fe00640 1 --2- 172.21.15.16:0/581097041 >> v2:172.21.15.32:3300/0 conn(0x7fb328142530 0x7fb3280b8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fb31fe00640 1 -- 172.21.15.16:0/581097041 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3280b59f0 con 0x7fb3280ba400 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fcfd7e00640 1 -- 172.21.15.16:0/466207736 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd8144920 msgr2=0x7fcfd8144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fcfd7e00640 1 --2- 172.21.15.16:0/466207736 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd8144920 0x7fcfd8144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fcfd7e00640 1 -- 172.21.15.16:0/466207736 >> v1:172.21.15.16:6789/0 conn(0x7fcfd8148100 legacy=0x7fcfd81484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7fcfd7e00640 1 -- 172.21.15.16:0/466207736 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd80b1290 con 0x7fcfd80b64e0 2024-04-26T23:34:52.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff2a0c00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7ff284074bc0 0x7ff284076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 --> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff294044e70 con 0x7ff284074bc0 2024-04-26T23:34:52.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff2940ad2a0 con 0x7ff2a40b6ab0 2024-04-26T23:34:52.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff374200640 1 -- 172.21.15.16:0/3088485246 shutdown_connections 2024-04-26T23:34:52.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff374200640 1 --2- 172.21.15.16:0/3088485246 >> v2:172.21.15.32:3300/0 conn(0x7ff36c142530 0x7ff36c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff374200640 1 --2- 172.21.15.16:0/3088485246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 0x7ff36c141ff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7ff374200640 1 -- 172.21.15.16:0/3088485246 >> 172.21.15.16:0/3088485246 conn(0x7ff36c0686c0 msgr2=0x7ff36c0bdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f3562200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f355c0ba400 0x7f355c1e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f3562200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f355c0be720 0x7f355c1ea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f3562200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c142530 0x7f355c1edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f3562200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f355c0b5de0 con 0x7f355c0be720 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f3562200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f355c0b7e10 con 0x7f355c0ba400 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f3562200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f355c0b6bd0 con 0x7f355c142530 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f355aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f355c0be720 0x7f355c1ea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f355aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f355c0be720 0x7f355c1ea6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35286/0 (socket says 172.21.15.16:35286) 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f355aa00640 1 -- 172.21.15.16:0/2176937929 learned_addr learned my addr 172.21.15.16:0/2176937929 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.867+0000 7f355b400640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f355c0ba400 0x7f355c1e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7f355aa00640 1 -- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c142530 msgr2=0x7f355c1edc20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7f355aa00640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f355c142530 0x7f355c1edc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7f355aa00640 1 -- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f355c0ba400 msgr2=0x7f355c1e0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7f355aa00640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f355c0ba400 0x7f355c1e0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.868+0000 7f355aa00640 1 -- 172.21.15.16:0/2176937929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c0bdb40 con 0x7f355c0be720 2024-04-26T23:34:52.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.869+0000 7ff2a9a00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7ff284074bc0 0x7ff284076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.869+0000 7f355aa00640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f355c0be720 0x7f355c1ea6b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f354802a770 tx=0x7f35480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.869+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a9c039040 con 0x7f0aa4148100 2024-04-26T23:34:52.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.869+0000 7ff374200640 1 -- 172.21.15.16:0/3088485246 shutdown_connections 2024-04-26T23:34:52.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.869+0000 7ff2a9000640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff28406c940 0x7ff28406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.869+0000 7ff374200640 1 -- 172.21.15.16:0/3088485246 wait complete. 2024-04-26T23:34:52.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.869+0000 7fb31fe00640 1 --2- 172.21.15.16:0/581097041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280ba400 0x7fb328141ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb3280beda0 tx=0x7fb31002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1078b6788880bca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7fcfd7e00640 1 --2- 172.21.15.16:0/466207736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfd80b64e0 0x7fcfd80b6970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40097a0 tx=0x7fcfc402a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20b91cdc2f7014f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7ff2a9a00640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7ff284074bc0 0x7ff284076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7fb327400640 1 -- 172.21.15.16:0/581097041 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310037070 con 0x7fb3280ba400 2024-04-26T23:34:52.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7fb327400640 1 -- 172.21.15.16:0/581097041 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb310032440 con 0x7fb3280ba400 2024-04-26T23:34:52.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7fb327400640 1 -- 172.21.15.16:0/581097041 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310032810 con 0x7fb3280ba400 2024-04-26T23:34:52.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548040020 con 0x7f355c0be720 2024-04-26T23:34:52.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3548038040 con 0x7f355c0be720 2024-04-26T23:34:52.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548037070 con 0x7f355c0be720 2024-04-26T23:34:52.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f1846c00640 1 Processor -- start 2024-04-26T23:34:52.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.870+0000 7f0a9b400640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0a8406c8f0 0x7f0a8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a9c0ad080 con 0x7f0aa4148100 2024-04-26T23:34:52.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355c0bcbf0 con 0x7f355c0be720 2024-04-26T23:34:52.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== osd.1 v2:172.21.15.16:6800/1499959106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff294044e70 con 0x7ff284074bc0 2024-04-26T23:34:52.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f0a9b400640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7f0a84074b70 0x7f0a84076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 --> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a84077640 con 0x7f0a84074b70 2024-04-26T23:34:52.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0a9c0ad470 con 0x7f0aa4148100 2024-04-26T23:34:52.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355c0bbe60 con 0x7f355c0be720 2024-04-26T23:34:52.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fb32ee00640 1 -- 172.21.15.16:0/581097041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280ba400 msgr2=0x7fb328141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fb32ee00640 1 --2- 172.21.15.16:0/581097041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280ba400 0x7fb328141ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb3280beda0 tx=0x7fb31002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fcfd7400640 1 -- 172.21.15.16:0/466207736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4037070 con 0x7fcfd80b64e0 2024-04-26T23:34:52.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fb32ee00640 1 -- 172.21.15.16:0/581097041 shutdown_connections 2024-04-26T23:34:52.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fb32ee00640 1 --2- 172.21.15.16:0/581097041 >> v2:172.21.15.32:3300/0 conn(0x7fb328142530 0x7fb3280b8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fb32ee00640 1 --2- 172.21.15.16:0/581097041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280ba400 0x7fb328141ff0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fb32ee00640 1 --2- 172.21.15.16:0/581097041 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb3280be720 0x7fb32814ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7fb32ee00640 1 -- 172.21.15.16:0/581097041 >> 172.21.15.16:0/581097041 conn(0x7fb3280686c0 msgr2=0x7fb3280bdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7fcfd7400640 1 -- 172.21.15.16:0/466207736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc402ae40 con 0x7fcfd80b64e0 2024-04-26T23:34:52.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7fcfd7400640 1 -- 172.21.15.16:0/466207736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4037070 con 0x7fcfd80b64e0 2024-04-26T23:34:52.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7f0aa2a00640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7f0a84074b70 0x7f0a84076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7fb32ee00640 1 -- 172.21.15.16:0/581097041 shutdown_connections 2024-04-26T23:34:52.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7fb32ee00640 1 -- 172.21.15.16:0/581097041 wait complete. 2024-04-26T23:34:52.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.871+0000 7f1846c00640 1 -- start start 2024-04-26T23:34:52.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7f1846c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18400b69c0 0x7f184013ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7f1846c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18400bb000 0x7f1840145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7f1846c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1840150e30 0x7f18400b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7f1846c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18400ba270 con 0x7f18400b69c0 2024-04-26T23:34:52.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7ff374200640 1 Processor -- start 2024-04-26T23:34:52.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7f1846c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f18400b80c0 con 0x7f1840150e30 2024-04-26T23:34:52.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7f1846c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f18400ba3f0 con 0x7f18400bb000 2024-04-26T23:34:52.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fc8030040 con 0x7f7fd809ec80 2024-04-26T23:34:52.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7f0aa3400640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0a8406c8f0 0x7f0a8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7f183f400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18400bb000 0x7f1840145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f183f400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18400bb000 0x7f1840145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56646/0 (socket says 172.21.15.16:56646) 2024-04-26T23:34:52.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f183f400640 1 -- 172.21.15.16:0/2206896753 learned_addr learned my addr 172.21.15.16:0/2206896753 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7ff374200640 1 -- start start 2024-04-26T23:34:52.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f1844c00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1840150e30 0x7f18400b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f0aa3400640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0a8406c8f0 0x7f0a8406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0aa415c800 tx=0x7f0a94009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f0aa2a00640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7f0a84074b70 0x7f0a84076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f7fce000640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7fb806c9c0 0x7f7fb806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7fc80aaf70 con 0x7f7fd809ec80 2024-04-26T23:34:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f7fce000640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f7fb8074c40 0x7f7fb8077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 --> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fc8040ec0 con 0x7f7fb8074c40 2024-04-26T23:34:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7fc80ab360 con 0x7f7fd809ec80 2024-04-26T23:34:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.872+0000 7ff2a9000640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff28406c940 0x7ff28406ee00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4072d90 tx=0x7ff29c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.874+0000 7f1844c00640 1 -- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18400bb000 msgr2=0x7f1840145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f1844c00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18400bb000 0x7f1840145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f1844c00640 1 -- 172.21.15.16:0/2206896753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18400b69c0 msgr2=0x7f184013ade0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:34:52.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f7fd5e00640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7fb806c9c0 0x7f7fb806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7fb32ee00640 1 Processor -- start 2024-04-26T23:34:52.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f7fd5400640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f7fb8074c40 0x7f7fb8077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f183fe00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18400b69c0 0x7f184013ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f1844c00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18400b69c0 0x7f184013ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f1844c00640 1 -- 172.21.15.16:0/2206896753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18400b2ca0 con 0x7f1840150e30 2024-04-26T23:34:52.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7f183fe00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18400b69c0 0x7f184013ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:52.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7f1844c00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1840150e30 0x7f18400b3740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1838030000 tx=0x7f1838004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== osd.0 v2:172.21.15.16:6808/2273435597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a84077640 con 0x7f0a84074b70 2024-04-26T23:34:52.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.875+0000 7fb32ee00640 1 -- start start 2024-04-26T23:34:52.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff374200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 0x7ff36c1450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff374200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff36c0be720 0x7ff36c1e2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff374200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff36c142530 0x7ff36c1e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff374200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0b5de0 con 0x7ff36c0ba400 2024-04-26T23:34:52.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff374200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0b7e10 con 0x7ff36c142530 2024-04-26T23:34:52.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff374200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c0b6bd0 con 0x7ff36c0be720 2024-04-26T23:34:52.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f355c069c20 con 0x7f355c0be720 2024-04-26T23:34:52.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3548043020 con 0x7f355c0be720 2024-04-26T23:34:52.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff370e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff36c0be720 0x7ff36c1e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7fb32ee00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3280ba400 0x7fb32814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff370e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff36c0be720 0x7ff36c1e2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56650/0 (socket says 172.21.15.16:56650) 2024-04-26T23:34:52.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7fb32ee00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280be720 0x7fb3281de020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb32ee00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb328142530 0x7fb328136f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838041020 con 0x7f1840150e30 2024-04-26T23:34:52.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7fcfdf800640 1 -- 172.21.15.16:0/466207736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfd80b64e0 msgr2=0x7fcfd80b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.873+0000 7fcfdf800640 1 --2- 172.21.15.16:0/466207736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfd80b64e0 0x7fcfd80b6970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40097a0 tx=0x7fcfc402a0f0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7ff370e00640 1 -- 172.21.15.16:0/663038374 learned_addr learned my addr 172.21.15.16:0/663038374 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1838008710 con 0x7f1840150e30 2024-04-26T23:34:52.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb32ee00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280b6bd0 con 0x7fb3280be720 2024-04-26T23:34:52.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb32ee00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fb3280b5de0 con 0x7fb3280ba400 2024-04-26T23:34:52.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb32ee00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fb328147310 con 0x7fb328142530 2024-04-26T23:34:52.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838036040 con 0x7f1840150e30 2024-04-26T23:34:52.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184013d3d0 con 0x7f1840150e30 2024-04-26T23:34:52.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7ff372200640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff36c142530 0x7ff36c1e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb327e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3280ba400 0x7fb32814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb327e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3280ba400 0x7fb32814b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:54236/0 (socket says 172.21.15.16:54236) 2024-04-26T23:34:52.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb327e00640 1 -- 172.21.15.16:0/816419144 learned_addr learned my addr 172.21.15.16:0/816419144 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fcfdf800640 1 -- 172.21.15.16:0/466207736 shutdown_connections 2024-04-26T23:34:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.876+0000 7f7fd5400640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f7fb8074c40 0x7f7fb8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fb32ce00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb328142530 0x7fb328136f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1840145a90 con 0x7f1840150e30 2024-04-26T23:34:52.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== osd.2 v2:172.21.15.16:6816/1958514319 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fc8040ec0 con 0x7f7fb8074c40 2024-04-26T23:34:52.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fcfdf800640 1 --2- 172.21.15.16:0/466207736 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd8144920 0x7fcfd8144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fcfdf800640 1 --2- 172.21.15.16:0/466207736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfd80b64e0 0x7fcfd80b6970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7fcfdf800640 1 -- 172.21.15.16:0/466207736 >> 172.21.15.16:0/466207736 conn(0x7fcfd806e2b0 msgr2=0x7fcfd806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7fcfdf800640 1 -- 172.21.15.16:0/466207736 shutdown_connections 2024-04-26T23:34:52.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7fcfdf800640 1 -- 172.21.15.16:0/466207736 wait complete. 2024-04-26T23:34:52.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7f7fd5e00640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7fb806c9c0 0x7f7fb806ee80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4007ab0 tx=0x7f7fc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7fb31fe00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280be720 0x7fb3281de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7fb327e00640 1 -- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb328142530 msgr2=0x7fb328136f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7fb327e00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fb328142530 0x7fb328136f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7fb327e00640 1 -- 172.21.15.16:0/816419144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280be720 msgr2=0x7fb3281de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7f3553400640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f353c06c940 0x7f353c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35480abf50 con 0x7f355c0be720 2024-04-26T23:34:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18400b3320 con 0x7f1840150e30 2024-04-26T23:34:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7fb327e00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280be720 0x7fb3281de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7fb327e00640 1 -- 172.21.15.16:0/816419144 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb328146530 con 0x7fb3280ba400 2024-04-26T23:34:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7fb31fe00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3280be720 0x7fb3281de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:52.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.877+0000 7ff370e00640 1 -- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff36c142530 msgr2=0x7ff36c1e2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7ff370e00640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff36c142530 0x7ff36c1e2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.878+0000 7ff370e00640 1 -- 172.21.15.16:0/663038374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 msgr2=0x7ff36c1450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7ff371800640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 0x7ff36c1450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7f3553400640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f353c074bc0 0x7f353c076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 --> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f354800af30 con 0x7f353c074bc0 2024-04-26T23:34:52.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.879+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f35480ae570 con 0x7f355c0be720 2024-04-26T23:34:52.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7fb327e00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3280ba400 0x7fb32814b740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e890 tx=0x7fb31800ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7fcfdf800640 1 Processor -- start 2024-04-26T23:34:52.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7ff370e00640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 0x7ff36c1450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7ff370e00640 1 -- 172.21.15.16:0/663038374 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c144650 con 0x7ff36c0be720 2024-04-26T23:34:52.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7ff371800640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff36c0ba400 0x7ff36c1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:52.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7f355b400640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f353c06c940 0x7f353c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7f355be00640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f353c074bc0 0x7f353c076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7fcfdf800640 1 -- start start 2024-04-26T23:34:52.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.880+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318017070 con 0x7fb3280ba400 2024-04-26T23:34:52.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.881+0000 7ff370e00640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff36c0be720 0x7ff36c1e2810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff360009f40 tx=0x7ff360004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.881+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb328147560 con 0x7fb3280ba400 2024-04-26T23:34:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.881+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb328144720 con 0x7fb3280ba400 2024-04-26T23:34:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.881+0000 7f355be00640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f353c074bc0 0x7f353c076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7f355b400640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f353c06c940 0x7f353c06ee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35540012e0 tx=0x7f3554009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.881+0000 7fcfdf800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd80b64e0 0x7fcfd809cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdf800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfd8144920 0x7fcfd809dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdf800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfd8148100 0x7fcfd8138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdf800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd80b96b0 con 0x7fcfd8148100 2024-04-26T23:34:52.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdf800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd80b9530 con 0x7fcfd8144920 2024-04-26T23:34:52.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdf800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd81452d0 con 0x7fcfd80b64e0 2024-04-26T23:34:52.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1838044020 con 0x7f1840150e30 2024-04-26T23:34:52.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.883+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360041020 con 0x7ff36c0be720 2024-04-26T23:34:52.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.883+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff360008730 con 0x7ff36c0be720 2024-04-26T23:34:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.883+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360036040 con 0x7ff36c0be720 2024-04-26T23:34:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.883+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36c0bbd60 con 0x7ff36c0be720 2024-04-26T23:34:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.881+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31800c940 con 0x7fb3280ba400 2024-04-26T23:34:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.881+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318017070 con 0x7fb3280ba400 2024-04-26T23:34:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb300001030 con 0x7fb3280ba400 2024-04-26T23:34:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.883+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== osd.3 v2:172.21.15.16:6824/882010783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f354800af30 con 0x7f353c074bc0 2024-04-26T23:34:52.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.883+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36c143760 con 0x7ff36c0be720 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdce00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd80b64e0 0x7fcfd809cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdce00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd80b64e0 0x7fcfd809cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56676/0 (socket says 172.21.15.16:56676) 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.882+0000 7fcfdce00640 1 -- 172.21.15.16:0/3614106128 learned_addr learned my addr 172.21.15.16:0/3614106128 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.883+0000 7fcfd7e00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfd8144920 0x7fcfd809dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7fcfdce00640 1 -- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfd8144920 msgr2=0x7fcfd809dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7fcfdce00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcfd8144920 0x7fcfd809dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7fcfdce00640 1 -- 172.21.15.16:0/3614106128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfd8148100 msgr2=0x7fcfd8138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7fcfdce00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcfd8148100 0x7fcfd8138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7fcfdce00640 1 -- 172.21.15.16:0/3614106128 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd809eca0 con 0x7fcfd80b64e0 2024-04-26T23:34:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7fcfdce00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd80b64e0 0x7fcfd809cd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000cbc0 tx=0x7fcfd000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7f1837e00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f182006c8f0 0x7f182006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f18380ad040 con 0x7f1840150e30 2024-04-26T23:34:52.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7f1837e00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f1820074af0 0x7f1820076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 --> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f183800ae60 con 0x7f1820074af0 2024-04-26T23:34:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.885+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff36c0693a0 con 0x7ff36c0be720 2024-04-26T23:34:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.884+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18380ad430 con 0x7f1840150e30 2024-04-26T23:34:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.885+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0017070 con 0x7fcfd80b64e0 2024-04-26T23:34:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.885+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd000aca0 con 0x7fcfd80b64e0 2024-04-26T23:34:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.885+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd813b530 con 0x7fcfd80b64e0 2024-04-26T23:34:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.885+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0012600 con 0x7fcfd80b64e0 2024-04-26T23:34:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.885+0000 7f183fe00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f182006c8f0 0x7f182006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.885+0000 7f183f400640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f1820074af0 0x7f1820076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.886+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd809d2a0 con 0x7fcfd80b64e0 2024-04-26T23:34:52.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.887+0000 7f183f400640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f1820074af0 0x7f1820076f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.887+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfd809fd90 con 0x7fcfd80b64e0 2024-04-26T23:34:52.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.886+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb31801a070 con 0x7fb3280ba400 2024-04-26T23:34:52.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.888+0000 7fb324c00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fb30406cb20 0x7fb30406efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.888+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb31808bdd0 con 0x7fb3280ba400 2024-04-26T23:34:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.888+0000 7fb324c00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7fb304074da0 0x7fb3040771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.888+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 --> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb304077870 con 0x7fb304074da0 2024-04-26T23:34:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.888+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb31808c1c0 con 0x7fb3280ba400 2024-04-26T23:34:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.889+0000 7f183fe00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f182006c8f0 0x7f182006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1830006fd0 tx=0x7f1830008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.889+0000 7fb32ce00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7fb304074da0 0x7fb3040771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.890+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== osd.5 v2:172.21.15.32:6800/2551335991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f183800ae60 con 0x7f1820074af0 2024-04-26T23:34:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.890+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcfd001a070 con 0x7fcfd80b64e0 2024-04-26T23:34:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.889+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff360044020 con 0x7ff36c0be720 2024-04-26T23:34:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.890+0000 7ff369600640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff34c06c9c0 0x7ff34c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.890+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3600acf40 con 0x7ff36c0be720 2024-04-26T23:34:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.890+0000 7ff369600640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7ff34c074c40 0x7ff34c077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.891+0000 7fb32ce00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7fb304074da0 0x7fb3040771c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.891+0000 7fb31fe00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fb30406cb20 0x7fb30406efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.891+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 --> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3600047f0 con 0x7ff34c074c40 2024-04-26T23:34:52.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.891+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3600ad330 con 0x7ff36c0be720 2024-04-26T23:34:52.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.891+0000 7ff371800640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff34c06c9c0 0x7ff34c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.891+0000 7ff372200640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7ff34c074c40 0x7ff34c077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.892+0000 7fcfd4c00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcfb806c8f0 0x7fcfb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.892+0000 7fb31fe00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fb30406cb20 0x7fb30406efe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb310034000 tx=0x7fb31002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.892+0000 7ff371800640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff34c06c9c0 0x7ff34c06ee80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff364000f60 tx=0x7ff364009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.893+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcfd008c2f0 con 0x7fcfd80b64e0 2024-04-26T23:34:52.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.893+0000 7fcfd7e00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcfb806c8f0 0x7fcfb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.893+0000 7fcfd4c00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7fcfb8074b70 0x7fcfb8076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:52.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.893+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 --> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfd000ae50 con 0x7fcfb8074b70 2024-04-26T23:34:52.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.894+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== osd.6 v2:172.21.15.32:6816/2056422341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb304077870 con 0x7fb304074da0 2024-04-26T23:34:52.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.894+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcfd008c6e0 con 0x7fcfd80b64e0 2024-04-26T23:34:52.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.894+0000 7fcfdd800640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7fcfb8074b70 0x7fcfb8076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:52.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.894+0000 7ff372200640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7ff34c074c40 0x7ff34c077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.895+0000 7fcfd7e00640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcfb806c8f0 0x7fcfb806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4034000 tx=0x7fcfc402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.896+0000 7fcfdd800640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7fcfb8074b70 0x7fcfb8076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:52.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.897+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== osd.4 v2:172.21.15.32:6824/1044755861 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3600047f0 con 0x7ff34c074c40 2024-04-26T23:34:52.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.898+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== osd.7 v2:172.21.15.32:6808/4001400243 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfd000ae50 con 0x7fcfb8074b70 2024-04-26T23:34:52.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.899+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 --> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2a4076600 con 0x7ff284074bc0 2024-04-26T23:34:52.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.900+0000 7ff2a0c00640 1 -- 172.21.15.16:0/1213747523 <== osd.1 v2:172.21.15.16:6800/1499959106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff2a4076600 con 0x7ff284074bc0 2024-04-26T23:34:52.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.903+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 --> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7fd8072fe0 con 0x7f7fb8074c40 2024-04-26T23:34:52.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.904+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7ff284074bc0 msgr2=0x7ff284076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.904+0000 7f7fce000640 1 -- 172.21.15.16:0/1496748518 <== osd.2 v2:172.21.15.16:6816/1958514319 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7fd00153f0 con 0x7f7fb8074c40 2024-04-26T23:34:52.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.904+0000 7ff2aa400640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7ff284074bc0 0x7ff284076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.905+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f7fb8074c40 msgr2=0x7f7fb8077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.905+0000 7f7fdd200640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f7fb8074c40 0x7f7fb8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.905+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7fb806c9c0 msgr2=0x7f7fb806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.905+0000 7f7fdd200640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7fb806c9c0 0x7f7fb806ee80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4007ab0 tx=0x7f7fc4009040 comp rx=0 tx=0).stop 2024-04-26T23:34:52.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.905+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd809ec80 msgr2=0x7f7fd809f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.905+0000 7f7fdd200640 1 --2- 172.21.15.16:0/1496748518 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7fd809ec80 0x7f7fd809f100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c410 tx=0x7f7fc8001120 comp rx=0 tx=0).stop 2024-04-26T23:34:52.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.906+0000 7f7fd6800640 1 -- 172.21.15.16:0/1496748518 reap_dead start 2024-04-26T23:34:52.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.906+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff28406c940 msgr2=0x7ff28406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.906+0000 7ff2aa400640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff28406c940 0x7ff28406ee00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4072d90 tx=0x7ff29c00b040 comp rx=0 tx=0).stop 2024-04-26T23:34:52.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.906+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2a40b6ab0 msgr2=0x7ff2a41db0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.906+0000 7ff2aa400640 1 --2- 172.21.15.16:0/1213747523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff2a40b6ab0 0x7ff2a41db0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40baa50 tx=0x7ff2940046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.906+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 shutdown_connections 2024-04-26T23:34:52.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.906+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 >> 172.21.15.16:0/1496748518 conn(0x7f7fd806d4a0 msgr2=0x7f7fd8150850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.907+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 shutdown_connections 2024-04-26T23:34:52.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.907+0000 7f7fdd200640 1 -- 172.21.15.16:0/1496748518 wait complete. 2024-04-26T23:34:52.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.907+0000 7ff2a9a00640 1 -- 172.21.15.16:0/1213747523 reap_dead start 2024-04-26T23:34:52.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.907+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 shutdown_connections 2024-04-26T23:34:52.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.907+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 >> 172.21.15.16:0/1213747523 conn(0x7ff2a4068270 msgr2=0x7ff2a4068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.907+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 shutdown_connections 2024-04-26T23:34:52.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.908+0000 7ff2aa400640 1 -- 172.21.15.16:0/1213747523 wait complete. 2024-04-26T23:34:52.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.909+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 --> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0aa40693a0 con 0x7f0a84074b70 2024-04-26T23:34:52.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.912+0000 7f0a9b400640 1 -- 172.21.15.16:0/2226591351 <== osd.0 v2:172.21.15.16:6808/2273435597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0aa40693a0 con 0x7f0a84074b70 2024-04-26T23:34:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.913+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7f0a84074b70 msgr2=0x7f0a84076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.913+0000 7f0aaa800640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7f0a84074b70 0x7f0a84076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.914+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0a8406c8f0 msgr2=0x7f0a8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.914+0000 7f0aaa800640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0a8406c8f0 0x7f0a8406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0aa415c800 tx=0x7f0a94009240 comp rx=0 tx=0).stop 2024-04-26T23:34:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.914+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 --> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f355c0bd0b0 con 0x7f353c074bc0 2024-04-26T23:34:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.914+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aa4148100 msgr2=0x7f0aa409bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.914+0000 7f0aaa800640 1 --2- 172.21.15.16:0/2226591351 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0aa4148100 0x7f0aa409bf60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009d90 tx=0x7f0a9c004a40 comp rx=0 tx=0).stop 2024-04-26T23:34:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.914+0000 7f0aa3e00640 1 -- 172.21.15.16:0/2226591351 reap_dead start 2024-04-26T23:34:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.915+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 shutdown_connections 2024-04-26T23:34:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.915+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 >> 172.21.15.16:0/2226591351 conn(0x7f0aa406e2b0 msgr2=0x7f0aa4145110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.915+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 shutdown_connections 2024-04-26T23:34:52.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.915+0000 7f3553400640 1 -- 172.21.15.16:0/2176937929 <== osd.3 v2:172.21.15.16:6824/882010783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f354800af30 con 0x7f353c074bc0 2024-04-26T23:34:52.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.916+0000 7f0aaa800640 1 -- 172.21.15.16:0/2226591351 wait complete. 2024-04-26T23:34:52.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.916+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f353c074bc0 msgr2=0x7f353c076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.916+0000 7f3562200640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f353c074bc0 0x7f353c076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.917+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f353c06c940 msgr2=0x7f353c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.917+0000 7f3562200640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f353c06c940 0x7f353c06ee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35540012e0 tx=0x7f3554009040 comp rx=0 tx=0).stop 2024-04-26T23:34:52.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.917+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f355c0be720 msgr2=0x7f355c1ea6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.917+0000 7f3562200640 1 --2- 172.21.15.16:0/2176937929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f355c0be720 0x7f355c1ea6b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f354802a770 tx=0x7f35480046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.917+0000 7f355be00640 1 -- 172.21.15.16:0/2176937929 reap_dead start 2024-04-26T23:34:52.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.917+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 shutdown_connections 2024-04-26T23:34:52.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.917+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 >> 172.21.15.16:0/2176937929 conn(0x7f355c0686c0 msgr2=0x7f355c06a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.918+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 shutdown_connections 2024-04-26T23:34:52.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.918+0000 7f3562200640 1 -- 172.21.15.16:0/2176937929 wait complete. 2024-04-26T23:34:52.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.922+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 --> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1840069ab0 con 0x7f1820074af0 2024-04-26T23:34:52.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.924+0000 7f1837e00640 1 -- 172.21.15.16:0/2206896753 <== osd.5 v2:172.21.15.32:6800/2551335991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1840069ab0 con 0x7f1820074af0 2024-04-26T23:34:52.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.924+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 --> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb300002dd0 con 0x7fb304074da0 2024-04-26T23:34:52.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.925+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f1820074af0 msgr2=0x7f1820076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.925+0000 7f1846c00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f1820074af0 0x7f1820076f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.925+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f182006c8f0 msgr2=0x7f182006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.925+0000 7f1846c00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f182006c8f0 0x7f182006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1830006fd0 tx=0x7f1830008040 comp rx=0 tx=0).stop 2024-04-26T23:34:52.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.925+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1840150e30 msgr2=0x7f18400b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.925+0000 7f1846c00640 1 --2- 172.21.15.16:0/2206896753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1840150e30 0x7f18400b3740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1838030000 tx=0x7f1838004a40 comp rx=0 tx=0).stop 2024-04-26T23:34:52.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.926+0000 7f1844c00640 1 -- 172.21.15.16:0/2206896753 reap_dead start 2024-04-26T23:34:52.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.926+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 shutdown_connections 2024-04-26T23:34:52.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.926+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 >> 172.21.15.16:0/2206896753 conn(0x7f18400684b0 msgr2=0x7f18400b86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.926+0000 7fb324c00640 1 -- 172.21.15.16:0/816419144 <== osd.6 v2:172.21.15.32:6816/2056422341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb300002dd0 con 0x7fb304074da0 2024-04-26T23:34:52.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.926+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 shutdown_connections 2024-04-26T23:34:52.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.926+0000 7f1846c00640 1 -- 172.21.15.16:0/2206896753 wait complete. 2024-04-26T23:34:52.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.927+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 --> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff36c072910 con 0x7ff34c074c40 2024-04-26T23:34:52.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.928+0000 7ff369600640 1 -- 172.21.15.16:0/663038374 <== osd.4 v2:172.21.15.32:6824/1044755861 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff36c072910 con 0x7ff34c074c40 2024-04-26T23:34:52.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7fb304074da0 msgr2=0x7fb3040771c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7fb304074da0 0x7fb3040771c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fb30406cb20 msgr2=0x7fb30406efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fb30406cb20 0x7fb30406efe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb310034000 tx=0x7fb31002e000 comp rx=0 tx=0).stop 2024-04-26T23:34:52.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3280ba400 msgr2=0x7fb32814b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 --2- 172.21.15.16:0/816419144 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb3280ba400 0x7fb32814b740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e890 tx=0x7fb31800ed50 comp rx=0 tx=0).stop 2024-04-26T23:34:52.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7ff34c074c40 msgr2=0x7ff34c077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7ff374200640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7ff34c074c40 0x7ff34c077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ce00640 1 -- 172.21.15.16:0/816419144 reap_dead start 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 shutdown_connections 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.929+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 >> 172.21.15.16:0/816419144 conn(0x7fb3280686c0 msgr2=0x7fb32806a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.930+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff34c06c9c0 msgr2=0x7ff34c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.930+0000 7ff374200640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff34c06c9c0 0x7ff34c06ee80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff364000f60 tx=0x7ff364009040 comp rx=0 tx=0).stop 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.930+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff36c0be720 msgr2=0x7ff36c1e2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.930+0000 7ff374200640 1 --2- 172.21.15.16:0/663038374 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff36c0be720 0x7ff36c1e2810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff360009f40 tx=0x7ff360004a40 comp rx=0 tx=0).stop 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.930+0000 7ff372200640 1 -- 172.21.15.16:0/663038374 reap_dead start 2024-04-26T23:34:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.930+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 shutdown_connections 2024-04-26T23:34:52.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.930+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 >> 172.21.15.16:0/663038374 conn(0x7ff36c0686c0 msgr2=0x7ff36c148e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.931+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 shutdown_connections 2024-04-26T23:34:52.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.931+0000 7ff374200640 1 -- 172.21.15.16:0/663038374 wait complete. 2024-04-26T23:34:52.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.931+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 shutdown_connections 2024-04-26T23:34:52.966 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:52.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.931+0000 7fb32ee00640 1 -- 172.21.15.16:0/816419144 wait complete. 2024-04-26T23:34:52.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:34:52.968 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:52.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:34:52.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.934+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 --> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcfd80693a0 con 0x7fcfb8074b70 2024-04-26T23:34:52.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.936+0000 7fcfd4c00640 1 -- 172.21.15.16:0/3614106128 <== osd.7 v2:172.21.15.32:6808/4001400243 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcfd80693a0 con 0x7fcfb8074b70 2024-04-26T23:34:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.936+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7fcfb8074b70 msgr2=0x7fcfb8076f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.936+0000 7fcfdf800640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7fcfb8074b70 0x7fcfb8076f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcfb806c8f0 msgr2=0x7fcfb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fcfb806c8f0 0x7fcfb806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4034000 tx=0x7fcfc402e000 comp rx=0 tx=0).stop 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd80b64e0 msgr2=0x7fcfd809cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 --2- 172.21.15.16:0/3614106128 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fcfd80b64e0 0x7fcfd809cd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000cbc0 tx=0x7fcfd000a060 comp rx=0 tx=0).stop 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdd800640 1 -- 172.21.15.16:0/3614106128 reap_dead start 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 shutdown_connections 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 >> 172.21.15.16:0/3614106128 conn(0x7fcfd806e2b0 msgr2=0x7fcfd81484e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 shutdown_connections 2024-04-26T23:34:52.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:52.937+0000 7fcfdf800640 1 -- 172.21.15.16:0/3614106128 wait complete. 2024-04-26T23:34:52.972 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:52.972 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:34:52.973 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:52.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:34:52.974 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:52.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:34:52.975 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:52.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:34:52.976 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:52.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:34:52.978 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-04-26T23:34:52.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:34:53.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.289+0000 7f14aa800640 1 Processor -- start 2024-04-26T23:34:53.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.289+0000 7f14aa800640 1 -- start start 2024-04-26T23:34:53.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.291+0000 7f14aa800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f14a4142960 0x7f14a40bba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.291+0000 7f14aa800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a409ce80 con 0x7f14a409caa0 2024-04-26T23:34:53.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.291+0000 7f14aa800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a409bc70 con 0x7f14a40bd6e0 2024-04-26T23:34:53.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.291+0000 7f14aa800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f14a409ba20 con 0x7f14a4142960 2024-04-26T23:34:53.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.292+0000 7f14a3400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f14a409caa0 0x7f14a4142250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32854/0 (socket says 172.21.15.16:32854) 2024-04-26T23:34:53.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.292+0000 7f14a3400640 1 -- 172.21.15.16:0/2338986196 learned_addr learned my addr 172.21.15.16:0/2338986196 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:53.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.292+0000 7f14a3e00640 1 --2- 172.21.15.16:0/2338986196 >> v2:172.21.15.32:3300/0 conn(0x7f14a4142960 0x7f14a40bba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014774842 0 0) 0x7f14a409ce80 con 0x7f14a409caa0 2024-04-26T23:34:53.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f148c003520 con 0x7f14a409caa0 2024-04-26T23:34:53.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1458113068 0 0) 0x7f148c003520 con 0x7f14a409caa0 2024-04-26T23:34:53.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 >> v2:172.21.15.32:3300/0 conn(0x7f14a4142960 msgr2=0x7f14a40bba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7f14a2000640 1 --2- 172.21.15.16:0/2338986196 >> v2:172.21.15.32:3300/0 conn(0x7f14a4142960 0x7f14a40bba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 >> v1:172.21.15.32:6789/0 conn(0x7f14a40bd6e0 legacy=0x7f14a4150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a409bf50 con 0x7f14a409caa0 2024-04-26T23:34:53.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f149c001a20 con 0x7f14a409caa0 2024-04-26T23:34:53.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 >> v1:172.21.15.16:6789/0 conn(0x7f14a409caa0 legacy=0x7f14a4142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f148c003a00 0x7f148c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f148c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f148c005410 0x7f148c00ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14a409ba20 con 0x7f148c004800 2024-04-26T23:34:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f148c00c350 con 0x7f148c003a00 2024-04-26T23:34:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f148c00c550 con 0x7f148c005410 2024-04-26T23:34:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7f14a3400640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f148c003a00 0x7f148c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.296+0000 7f14a2a00640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f148c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7fe8cf200640 1 Processor -- start 2024-04-26T23:34:53.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.293+0000 7fe8cf200640 1 -- start start 2024-04-26T23:34:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7fe8cf200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d0142920 0x7fe8d00bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.294+0000 7fe8cf200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe8d009d270 0x7fe8d0148770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7fe8ce800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe8d009d270 0x7fe8d0148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7fe8ce800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe8d009d270 0x7fe8d0148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35318/0 (socket says 172.21.15.16:35318) 2024-04-26T23:34:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7fe8ce800640 1 -- 172.21.15.16:0/466467189 learned_addr learned my addr 172.21.15.16:0/466467189 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d009c200 con 0x7fe8d009be20 2024-04-26T23:34:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d00bb9e0 con 0x7fe8d009d270 2024-04-26T23:34:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d00bbc30 con 0x7fe8d0142920 2024-04-26T23:34:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.295+0000 7fe8cd400640 1 --2- 172.21.15.16:0/466467189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d0142920 0x7fe8d00bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7f14a2a00640 1 -- 172.21.15.16:0/2338986196 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f148c005410 msgr2=0x7f148c00ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7f14a2a00640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f148c005410 0x7f148c00ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7f14a2a00640 1 -- 172.21.15.16:0/2338986196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f148c003a00 msgr2=0x7f148c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7f14a2a00640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f148c003a00 0x7f148c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7f14a2a00640 1 -- 172.21.15.16:0/2338986196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c003520 con 0x7f148c004800 2024-04-26T23:34:53.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7f14a3e00640 1 -- 172.21.15.16:0/2338986196 reap_dead start 2024-04-26T23:34:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7fe8ce800640 1 -- 172.21.15.16:0/466467189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d0142920 msgr2=0x7fe8d00bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7fe8ce800640 1 --2- 172.21.15.16:0/466467189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d0142920 0x7fe8d00bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7fe8ce800640 1 -- 172.21.15.16:0/466467189 >> v1:172.21.15.32:6789/0 conn(0x7fe8d009be20 legacy=0x7fe8d0142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.297+0000 7fe8ce800640 1 -- 172.21.15.16:0/466467189 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d009c7e0 con 0x7fe8d009d270 2024-04-26T23:34:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.298+0000 7fe8cd400640 1 --2- 172.21.15.16:0/466467189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d0142920 0x7fe8d00bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.298+0000 7f14a2a00640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f148c004c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1498001640 tx=0x7f148c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf650151631fa47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.299+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498001240 con 0x7f148c004800 2024-04-26T23:34:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.299+0000 7fe8ce800640 1 --2- 172.21.15.16:0/466467189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d0148770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009870 tx=0x7fe8bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3cc6416f079fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.300+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149802e070 con 0x7f148c004800 2024-04-26T23:34:53.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.300+0000 7f14a2000640 1 -- 172.21.15.16:0/2338986196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149802a7c0 con 0x7f148c004800 2024-04-26T23:34:53.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.300+0000 7fe8cca00640 1 -- 172.21.15.16:0/466467189 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc037070 con 0x7fe8d009d270 2024-04-26T23:34:53.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.300+0000 7fe8cca00640 1 -- 172.21.15.16:0/466467189 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8bc032440 con 0x7fe8d009d270 2024-04-26T23:34:53.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.300+0000 7fe8cca00640 1 -- 172.21.15.16:0/466467189 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc032810 con 0x7fe8d009d270 2024-04-26T23:34:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.301+0000 7f14aa800640 1 -- 172.21.15.16:0/2338986196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 msgr2=0x7f148c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.301+0000 7f14aa800640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f148c004c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1498001640 tx=0x7f148c005830 comp rx=0 tx=0).stop 2024-04-26T23:34:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.302+0000 7f14aa800640 1 -- 172.21.15.16:0/2338986196 shutdown_connections 2024-04-26T23:34:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.302+0000 7f14aa800640 1 --2- 172.21.15.16:0/2338986196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f148c004c80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.302+0000 7f14aa800640 1 -- 172.21.15.16:0/2338986196 >> 172.21.15.16:0/2338986196 conn(0x7f14a409fa50 msgr2=0x7f14a409fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.303+0000 7f14aa800640 1 -- 172.21.15.16:0/2338986196 shutdown_connections 2024-04-26T23:34:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.303+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 msgr2=0x7fe8d0148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.303+0000 7f14aa800640 1 -- 172.21.15.16:0/2338986196 wait complete. 2024-04-26T23:34:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.303+0000 7fe8cf200640 1 --2- 172.21.15.16:0/466467189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d0148770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009870 tx=0x7fe8bc02a180 comp rx=0 tx=0).stop 2024-04-26T23:34:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.304+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 shutdown_connections 2024-04-26T23:34:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.304+0000 7fe8cf200640 1 --2- 172.21.15.16:0/466467189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d0148770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.304+0000 7fe8cf200640 1 --2- 172.21.15.16:0/466467189 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d0142920 0x7fe8d00bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.304+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 >> 172.21.15.16:0/466467189 conn(0x7fe8d009fa50 msgr2=0x7fe8d009fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.305+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 shutdown_connections 2024-04-26T23:34:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.305+0000 7f14aa800640 1 Processor -- start 2024-04-26T23:34:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.305+0000 7f14aa800640 1 -- start start 2024-04-26T23:34:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.305+0000 7fe8cf200640 1 -- 172.21.15.16:0/466467189 wait complete. 2024-04-26T23:34:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7f14aa800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f14a40a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7f14aa800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f14a41dcb40 0x7f14a40b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7f14aa800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a41dcfc0 0x7f14a40b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7f14aa800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14a40b9d60 con 0x7f148c004800 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7f14aa800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f14a40ba400 con 0x7f14a41dcfc0 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7f14aa800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f14a40bba40 con 0x7f14a41dcb40 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.307+0000 7f14a3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f14a40a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.307+0000 7f14a3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f14a40a24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35328/0 (socket says 172.21.15.16:35328) 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.307+0000 7f14a3400640 1 -- 172.21.15.16:0/274188480 learned_addr learned my addr 172.21.15.16:0/274188480 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7fdaa7000640 1 Processor -- start 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.306+0000 7fdaa7000640 1 -- start start 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa7000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdaa009be20 0x7fdaa00bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa7000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009d270 0x7fdaa0142210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa7000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdaa0142750 0x7fdaa0148770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa7000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa00bb9e0 con 0x7fdaa009be20 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa7000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa009c200 con 0x7fdaa0142750 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa7000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa00bbc30 con 0x7fdaa009d270 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa5c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdaa009be20 0x7fdaa00bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.307+0000 7f14a3400640 1 -- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f14a41dcb40 msgr2=0x7f14a40b75b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.307+0000 7f14a3400640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f14a41dcb40 0x7f14a40b75b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7f14a3400640 1 -- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a41dcfc0 msgr2=0x7f14a40b7af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:34:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7f14a3400640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a41dcfc0 0x7f14a40b7af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7f14a3400640 1 -- 172.21.15.16:0/274188480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a40b5070 con 0x7f148c004800 2024-04-26T23:34:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7f14a3400640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f14a40a24c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f149c001ae0 tx=0x7f149c00d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa5c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdaa009be20 0x7fdaa00bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35344/0 (socket says 172.21.15.16:35344) 2024-04-26T23:34:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.308+0000 7fdaa5c00640 1 -- 172.21.15.16:0/2994885773 learned_addr learned my addr 172.21.15.16:0/2994885773 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7f1497400640 1 -- 172.21.15.16:0/274188480 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c022070 con 0x7f148c004800 2024-04-26T23:34:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7f1497400640 1 -- 172.21.15.16:0/274188480 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149c01a580 con 0x7f148c004800 2024-04-26T23:34:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7fdaa5c00640 1 -- 172.21.15.16:0/2994885773 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009d270 msgr2=0x7fdaa0142210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:34:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7fdaa5c00640 1 --2- 172.21.15.16:0/2994885773 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009d270 0x7fdaa0142210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7fdaa5c00640 1 -- 172.21.15.16:0/2994885773 >> v2:172.21.15.32:3300/0 conn(0x7fdaa0142750 msgr2=0x7fdaa0148770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:34:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7fdaa5c00640 1 --2- 172.21.15.16:0/2994885773 >> v2:172.21.15.32:3300/0 conn(0x7fdaa0142750 0x7fdaa0148770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7fdaa5c00640 1 -- 172.21.15.16:0/2994885773 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa009c7e0 con 0x7fdaa009be20 2024-04-26T23:34:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7f1497400640 1 -- 172.21.15.16:0/274188480 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c01a950 con 0x7f148c004800 2024-04-26T23:34:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7f14aa800640 1 -- 172.21.15.16:0/274188480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a40a16e0 con 0x7f148c004800 2024-04-26T23:34:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7f14aa800640 1 -- 172.21.15.16:0/274188480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a40a2a00 con 0x7f148c004800 2024-04-26T23:34:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7fe8cf200640 1 Processor -- start 2024-04-26T23:34:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.309+0000 7fe8cf200640 1 -- start start 2024-04-26T23:34:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fdaa5c00640 1 --2- 172.21.15.16:0/2994885773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa009be20 0x7fdaa00bd460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0149430 tx=0x7fda9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb5ed2862f2fb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cf200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d009be20 0x7fe8d00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cf200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d00a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cf200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8d0142920 0x7fe8d00b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cf200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0149080 con 0x7fe8d009d270 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cf200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0148f00 con 0x7fe8d0142920 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cf200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d0152cf0 con 0x7fe8d009be20 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d00a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d00a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35360/0 (socket says 172.21.15.16:35360) 2024-04-26T23:34:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7f7de1e00640 1 Processor -- start 2024-04-26T23:34:53.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.311+0000 7fe8cd400640 1 -- 172.21.15.16:0/4041888799 learned_addr learned my addr 172.21.15.16:0/4041888799 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fda9fe00640 1 -- 172.21.15.16:0/2994885773 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94037070 con 0x7fdaa009be20 2024-04-26T23:34:53.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fda9fe00640 1 -- 172.21.15.16:0/2994885773 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94032440 con 0x7fdaa009be20 2024-04-26T23:34:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fe8cde00640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d009be20 0x7fe8d00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fda9fe00640 1 -- 172.21.15.16:0/2994885773 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94032810 con 0x7fdaa009be20 2024-04-26T23:34:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fe8cd400640 1 -- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d009be20 msgr2=0x7fe8d00b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fe8cd400640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d009be20 0x7fe8d00b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fe8cd400640 1 -- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8d0142920 msgr2=0x7fe8d00b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fe8cd400640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8d0142920 0x7fe8d00b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7fe8cd400640 1 -- 172.21.15.16:0/4041888799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d00a2970 con 0x7fe8d009d270 2024-04-26T23:34:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7fe8cd400640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d00a2430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d800 tx=0x7fe8c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7fe8c6000640 1 -- 172.21.15.16:0/4041888799 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004030 con 0x7fe8d009d270 2024-04-26T23:34:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.312+0000 7f7de1e00640 1 -- start start 2024-04-26T23:34:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7fe8c6000640 1 -- 172.21.15.16:0/4041888799 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c00041d0 con 0x7fe8d009d270 2024-04-26T23:34:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7fe8c6000640 1 -- 172.21.15.16:0/4041888799 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000b660 con 0x7fe8d009d270 2024-04-26T23:34:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7f7de1e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc0ba3f0 0x7f7ddc142170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.314+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d00a2bf0 con 0x7fe8d009d270 2024-04-26T23:34:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.314+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d00a33d0 con 0x7fe8d009d270 2024-04-26T23:34:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7f7de1e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc0beac0 con 0x7f7ddc0be6e0 2024-04-26T23:34:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.314+0000 7f14aa800640 1 -- 172.21.15.16:0/274188480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1480005290 con 0x7f148c004800 2024-04-26T23:34:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7f7de1e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc0b57c0 con 0x7f7ddc14c270 2024-04-26T23:34:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.313+0000 7f7de1e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc0b5aa0 con 0x7f7ddc0ba3f0 2024-04-26T23:34:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.315+0000 7f7ddaa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7ddc0be6e0 0x7f7ddc14bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32860/0 (socket says 172.21.15.16:32860) 2024-04-26T23:34:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.315+0000 7f7ddaa00640 1 -- 172.21.15.16:0/2957647698 learned_addr learned my addr 172.21.15.16:0/2957647698 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.315+0000 7f7ddb400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7ddc14c270 0x7f7ddc152df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:50520/0 (socket says 172.21.15.16:50520) 2024-04-26T23:34:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.316+0000 7f7dd3e00640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc0ba3f0 0x7f7ddc142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.314+0000 7f1497400640 1 -- 172.21.15.16:0/274188480 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f149c025070 con 0x7f148c004800 2024-04-26T23:34:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.315+0000 7f1497400640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f148406c920 0x7f148406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.316+0000 7f1497400640 1 -- 172.21.15.16:0/274188480 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f149c0942a0 con 0x7f148c004800 2024-04-26T23:34:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.315+0000 7fdaa7000640 1 -- 172.21.15.16:0/2994885773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa009be20 msgr2=0x7fdaa00bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.315+0000 7fdaa7000640 1 --2- 172.21.15.16:0/2994885773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa009be20 0x7fdaa00bd460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0149430 tx=0x7fda9402a180 comp rx=0 tx=0).stop 2024-04-26T23:34:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7fdaa7000640 1 -- 172.21.15.16:0/2994885773 shutdown_connections 2024-04-26T23:34:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7fdaa7000640 1 --2- 172.21.15.16:0/2994885773 >> v2:172.21.15.32:3300/0 conn(0x7fdaa0142750 0x7fdaa0148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7fdaa7000640 1 --2- 172.21.15.16:0/2994885773 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009d270 0x7fdaa0142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416322327 0 0) 0x7f7ddc0b57c0 con 0x7f7ddc14c270 2024-04-26T23:34:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc0003520 con 0x7f7ddc14c270 2024-04-26T23:34:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7fdaa7000640 1 --2- 172.21.15.16:0/2994885773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa009be20 0x7fdaa00bd460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.316+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d0076670 con 0x7fe8d009d270 2024-04-26T23:34:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7fdaa7000640 1 -- 172.21.15.16:0/2994885773 >> 172.21.15.16:0/2994885773 conn(0x7fdaa009fa50 msgr2=0x7fdaa009fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f14a2a00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f148406c920 0x7f148406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7fdaa7000640 1 -- 172.21.15.16:0/2994885773 shutdown_connections 2024-04-26T23:34:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7fdaa7000640 1 -- 172.21.15.16:0/2994885773 wait complete. 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 <== mon.1 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2820167707 0 0) 0x7f7dc0003520 con 0x7f7ddc14c270 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc0ba3f0 msgr2=0x7f7ddc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc0ba3f0 0x7f7ddc142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 >> v1:172.21.15.16:6789/0 conn(0x7f7ddc0be6e0 legacy=0x7f7ddc14bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc0b5d80 con 0x7f7ddc14c270 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 <== mon.1 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f7dd4001920 con 0x7f7ddc14c270 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.317+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 >> v1:172.21.15.32:6789/0 conn(0x7f7ddc14c270 legacy=0x7f7ddc152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.318+0000 7f7dda000640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dc00039b0 0x7f7dc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.318+0000 7f7dda000640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc0004800 0x7f7dc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.318+0000 7f7dda000640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7dc0005210 0x7f7dc000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.318+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc0b5aa0 con 0x7f7dc0004800 2024-04-26T23:34:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.318+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc000c0c0 con 0x7f7dc00039b0 2024-04-26T23:34:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.318+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc000c2c0 con 0x7f7dc0005210 2024-04-26T23:34:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.319+0000 7fe8c6000640 1 -- 172.21.15.16:0/4041888799 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8c000b800 con 0x7fe8d009d270 2024-04-26T23:34:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.319+0000 7f14a2a00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f148406c920 0x7f148406ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1498032000 tx=0x7f1498005000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.319+0000 7f7ddaa00640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dc00039b0 0x7f7dc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.319+0000 7f7ddb400640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7dc0005210 0x7f7dc000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.320+0000 7f7dd3e00640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc0004800 0x7f7dc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.320+0000 7fdaa7000640 1 Processor -- start 2024-04-26T23:34:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.320+0000 7fdaa7000640 1 -- start start 2024-04-26T23:34:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.320+0000 7f7ddaa00640 1 -- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7dc0005210 msgr2=0x7f7dc000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fe8c6000640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe8b006c8f0 0x7fe8b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.321+0000 7fdaa7000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009be20 0x7fdaa014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa7000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa009d270 0x7fdaa01e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa7000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa0142750 0x7fdaa0149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa7000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0149040 con 0x7fdaa0142750 2024-04-26T23:34:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa7000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa0148ec0 con 0x7fdaa009d270 2024-04-26T23:34:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa7000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa0073400 con 0x7fdaa009be20 2024-04-26T23:34:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.321+0000 7f7ddaa00640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7dc0005210 0x7f7dc000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.321+0000 7f7ddaa00640 1 -- 172.21.15.16:0/2957647698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc0004800 msgr2=0x7f7dc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.321+0000 7f7ddaa00640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc0004800 0x7f7dc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.321+0000 7f7ddaa00640 1 -- 172.21.15.16:0/2957647698 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc0003520 con 0x7f7dc00039b0 2024-04-26T23:34:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa6600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa0142750 0x7fdaa0149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7f7ddaa00640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dc00039b0 0x7f7dc0003dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc14cb80 tx=0x7f7dc0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a101fc538eb45cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa6600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa0142750 0x7fdaa0149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35376/0 (socket says 172.21.15.16:35376) 2024-04-26T23:34:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa6600640 1 -- 172.21.15.16:0/1408482490 learned_addr learned my addr 172.21.15.16:0/1408482490 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.322+0000 7fdaa5200640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa009d270 0x7fdaa01e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fe8c6000640 1 -- 172.21.15.16:0/4041888799 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe8c008bca0 con 0x7fe8d009d270 2024-04-26T23:34:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fe8cde00640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe8b006c8f0 0x7fe8b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fdaa5c00640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009be20 0x7fdaa014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7f7bae400640 1 Processor -- start 2024-04-26T23:34:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fdaa6600640 1 -- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009be20 msgr2=0x7fdaa014c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fdaa6600640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009be20 0x7fdaa014c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fdaa6600640 1 -- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa009d270 msgr2=0x7fdaa01e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fdaa6600640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa009d270 0x7fdaa01e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fdaa6600640 1 -- 172.21.15.16:0/1408482490 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa0149530 con 0x7fdaa0142750 2024-04-26T23:34:53.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.323+0000 7fdaa5c00640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009be20 0x7fdaa014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.324+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc001460 con 0x7f7dc00039b0 2024-04-26T23:34:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.324+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc02e070 con 0x7f7dc00039b0 2024-04-26T23:34:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.324+0000 7f7dda000640 1 -- 172.21.15.16:0/2957647698 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc02ae60 con 0x7f7dc00039b0 2024-04-26T23:34:53.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.324+0000 7fba51a00640 1 Processor -- start 2024-04-26T23:34:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.324+0000 7fdaa6600640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa0142750 0x7fdaa0149f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda9800b990 tx=0x7fda9800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.324+0000 7f7bae400640 1 -- start start 2024-04-26T23:34:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.324+0000 7fba51a00640 1 -- start start 2024-04-26T23:34:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.325+0000 7f7de1e00640 1 -- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dc00039b0 msgr2=0x7f7dc0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.325+0000 7f7de1e00640 1 --2- 172.21.15.16:0/2957647698 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dc00039b0 0x7f7dc0003dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc14cb80 tx=0x7f7dc0005830 comp rx=0 tx=0).stop 2024-04-26T23:34:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.325+0000 7f7ddb400640 1 -- 172.21.15.16:0/2957647698 reap_dead start 2024-04-26T23:34:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.325+0000 7fe8cde00640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe8b006c8f0 0x7fe8b006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005520 tx=0x7fe8c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.325+0000 7f9a5e200640 1 Processor -- start 2024-04-26T23:34:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.325+0000 7f6381c00640 1 Processor -- start 2024-04-26T23:34:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7de1e00640 1 -- 172.21.15.16:0/2957647698 shutdown_connections 2024-04-26T23:34:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7de1e00640 1 -- 172.21.15.16:0/2957647698 >> 172.21.15.16:0/2957647698 conn(0x7f7ddc0686c0 msgr2=0x7f7ddc0bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7bae400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ba0038990 0x7f7ba00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7bae400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7ba003e090 0x7f7ba0039570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7bae400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0039ab0 0x7f7ba003a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7bae400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7ba00ccb50 con 0x7f7ba0038990 2024-04-26T23:34:53.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7bae400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f7ba00cce30 con 0x7f7ba003e090 2024-04-26T23:34:53.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f7bae400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba00cd110 con 0x7f7ba0039ab0 2024-04-26T23:34:53.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.325+0000 7f1497400640 1 -- 172.21.15.16:0/274188480 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f149c0626c0 con 0x7f148c004800 2024-04-26T23:34:53.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7fba51a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fba4c14c270 0x7fba4c153e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7fba51a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4c0beac0 con 0x7fba4c0ba3f0 2024-04-26T23:34:53.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7fba51a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4c0b57c0 con 0x7fba4c0be6e0 2024-04-26T23:34:53.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7fba51a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fba4c0b5aa0 con 0x7fba4c14c270 2024-04-26T23:34:53.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7fba4a000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fba4c0ba3f0 0x7fba4c142170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32864/0 (socket says 172.21.15.16:32864) 2024-04-26T23:34:53.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7fba4a000640 1 -- 172.21.15.16:0/3381647100 learned_addr learned my addr 172.21.15.16:0/3381647100 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:53.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ba0038990 0x7f7ba00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ba0038990 0x7f7ba00cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35390/0 (socket says 172.21.15.16:35390) 2024-04-26T23:34:53.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 -- 172.21.15.16:0/2135973090 learned_addr learned my addr 172.21.15.16:0/2135973090 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f6381c00640 1 -- start start 2024-04-26T23:34:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7ba7e00640 1 --2- 172.21.15.16:0/2135973090 >> v2:172.21.15.32:3300/0 conn(0x7f7ba003e090 0x7f7ba0039570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bada00640 1 --2- 172.21.15.16:0/2135973090 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0039ab0 0x7f7ba003a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 -- 172.21.15.16:0/2135973090 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0039ab0 msgr2=0x7f7ba003a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 --2- 172.21.15.16:0/2135973090 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0039ab0 0x7f7ba003a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 -- 172.21.15.16:0/2135973090 >> v2:172.21.15.32:3300/0 conn(0x7f7ba003e090 msgr2=0x7f7ba0039570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 --2- 172.21.15.16:0/2135973090 >> v2:172.21.15.32:3300/0 conn(0x7f7ba003e090 0x7f7ba0039570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f7bad000640 1 -- 172.21.15.16:0/2135973090 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba0038d70 con 0x7f7ba0038990 2024-04-26T23:34:53.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7fba4b400640 1 --2- 172.21.15.16:0/3381647100 >> v2:172.21.15.16:3300/0 conn(0x7fba4c14c270 0x7fba4c153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.327+0000 7f6381c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b1760 0x7f637c144940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.326+0000 7f9a5e200640 1 -- start start 2024-04-26T23:34:53.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f7de1e00640 1 -- 172.21.15.16:0/2957647698 shutdown_connections 2024-04-26T23:34:53.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7fba49600640 1 -- 172.21.15.16:0/3381647100 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335269940 0 0) 0x7fba4c0b57c0 con 0x7fba4c0be6e0 2024-04-26T23:34:53.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7fba49600640 1 -- 172.21.15.16:0/3381647100 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba30003520 con 0x7fba4c0be6e0 2024-04-26T23:34:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f6381c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c06eef0 con 0x7f637c06eb10 2024-04-26T23:34:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f6381c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c0b0c10 con 0x7f637c0b03e0 2024-04-26T23:34:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f6381c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f637c0af4d0 con 0x7f637c0b1760 2024-04-26T23:34:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f637aa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f637c06eb10 0x7f637c0afad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32872/0 (socket says 172.21.15.16:32872) 2024-04-26T23:34:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f637aa00640 1 -- 172.21.15.16:0/101697981 learned_addr learned my addr 172.21.15.16:0/101697981 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f637a000640 1 --2- 172.21.15.16:0/101697981 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b1760 0x7f637c144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.328+0000 7f7de1e00640 1 -- 172.21.15.16:0/2957647698 wait complete. 2024-04-26T23:34:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7fba4b400640 1 -- 172.21.15.16:0/3381647100 >> v1:172.21.15.32:6789/0 conn(0x7fba4c0be6e0 legacy=0x7fba4c14bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7f9a5e200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9a5806e0c0 0x7f9a580af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7f9a5e200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a58150050 0x7f9a580b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7fba49600640 1 -- 172.21.15.16:0/3381647100 <== mon.1 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 903322697 0 0) 0x7fba30003520 con 0x7fba4c0be6e0 2024-04-26T23:34:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7f637a000640 1 -- 172.21.15.16:0/101697981 >> v1:172.21.15.32:6789/0 conn(0x7f637c0b03e0 legacy=0x7f637c144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7f637a000640 1 -- 172.21.15.16:0/101697981 >> v1:172.21.15.16:6789/0 conn(0x7f637c06eb10 legacy=0x7f637c0afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7f637a000640 1 -- 172.21.15.16:0/101697981 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c0b12d0 con 0x7f637c0b1760 2024-04-26T23:34:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7f9a5e200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9a5806e4a0 0x7f9a580b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7f7bad000640 1 --2- 172.21.15.16:0/2135973090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0038990 0x7f7ba00cc550 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ba003bf80 tx=0x7f7b9402a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27600dac88c3e50d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a5e200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9a580b5a40 con 0x7f9a5806e4a0 2024-04-26T23:34:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a5e200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f9a580b6410 con 0x7f9a5806e0c0 2024-04-26T23:34:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a5e200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f9a580af9c0 con 0x7f9a58150050 2024-04-26T23:34:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9a5806e4a0 0x7f9a580b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7fba4b400640 1 -- 172.21.15.16:0/3381647100 >> v1:172.21.15.16:6789/0 conn(0x7fba4c0ba3f0 legacy=0x7fba4c142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.329+0000 7fba4b400640 1 -- 172.21.15.16:0/3381647100 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c0b5d80 con 0x7fba4c14c270 2024-04-26T23:34:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9a5806e4a0 0x7f9a580b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35414/0 (socket says 172.21.15.16:35414) 2024-04-26T23:34:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 -- 172.21.15.16:0/4176349195 learned_addr learned my addr 172.21.15.16:0/4176349195 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7fba4b400640 1 --2- 172.21.15.16:0/3381647100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c14c270 0x7fba4c153e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba38009720 tx=0x7fba3802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fba0f7601b394f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f637a000640 1 --2- 172.21.15.16:0/101697981 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b1760 0x7f637c144940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097d0 tx=0x7f636c02a120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b33cbe5de50000a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a56a00640 1 --2- 172.21.15.16:0/4176349195 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a58150050 0x7f9a580b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f7de1e00640 1 Processor -- start 2024-04-26T23:34:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f7de1e00640 1 -- start start 2024-04-26T23:34:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9a5806e0c0 0x7f9a580af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 -- 172.21.15.16:0/4176349195 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a58150050 msgr2=0x7f9a580b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 --2- 172.21.15.16:0/4176349195 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a58150050 0x7f9a580b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 -- 172.21.15.16:0/4176349195 >> v2:172.21.15.32:3300/0 conn(0x7f9a5806e0c0 msgr2=0x7f9a580af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 --2- 172.21.15.16:0/4176349195 >> v2:172.21.15.32:3300/0 conn(0x7f9a5806e0c0 0x7f9a580af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.330+0000 7f9a57e00640 1 -- 172.21.15.16:0/4176349195 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a580afca0 con 0x7f9a5806e4a0 2024-04-26T23:34:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f6379600640 1 -- 172.21.15.16:0/101697981 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c037070 con 0x7f637c0b1760 2024-04-26T23:34:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f6379600640 1 -- 172.21.15.16:0/101697981 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c02ae30 con 0x7f637c0b1760 2024-04-26T23:34:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f6379600640 1 -- 172.21.15.16:0/101697981 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c032640 con 0x7f637c0b1760 2024-04-26T23:34:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f7de1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc00039b0 0x7f7ddc1e0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f7de1e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc142d60 0x7f7ddc1d78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f7de1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ddc1d7e30 0x7f7ddc1dde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f7de1e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc0b6d80 con 0x7f7dc00039b0 2024-04-26T23:34:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.331+0000 7f7de1e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc0b6c00 con 0x7f7ddc1d7e30 2024-04-26T23:34:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7de1e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc142170 con 0x7f7ddc142d60 2024-04-26T23:34:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f9a57e00640 1 --2- 172.21.15.16:0/4176349195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a580b35f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a5806ec60 tx=0x7f9a4402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa57533becf9525 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc00039b0 0x7f7ddc1e0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc00039b0 0x7f7ddc1e0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35426/0 (socket says 172.21.15.16:35426) 2024-04-26T23:34:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 -- 172.21.15.16:0/971969363 learned_addr learned my addr 172.21.15.16:0/971969363 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f6381c00640 1 -- 172.21.15.16:0/101697981 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b1760 msgr2=0x7f637c144940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f6381c00640 1 --2- 172.21.15.16:0/101697981 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b1760 0x7f637c144940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097d0 tx=0x7f636c02a120 comp rx=0 tx=0).stop 2024-04-26T23:34:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddb400640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ddc1d7e30 0x7f7ddc1dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7dd3e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc142d60 0x7f7ddc1d78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 -- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc142d60 msgr2=0x7f7ddc1d78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc142d60 0x7f7ddc1d78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 -- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ddc1d7e30 msgr2=0x7f7ddc1dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ddc1d7e30 0x7f7ddc1dde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f6381c00640 1 -- 172.21.15.16:0/101697981 shutdown_connections 2024-04-26T23:34:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f6381c00640 1 --2- 172.21.15.16:0/101697981 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b1760 0x7f637c144940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f6381c00640 1 -- 172.21.15.16:0/101697981 >> 172.21.15.16:0/101697981 conn(0x7f637c0b6630 msgr2=0x7f637c0b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.332+0000 7f7ddaa00640 1 -- 172.21.15.16:0/971969363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc1e1960 con 0x7f7dc00039b0 2024-04-26T23:34:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.333+0000 7f6381c00640 1 -- 172.21.15.16:0/101697981 shutdown_connections 2024-04-26T23:34:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.333+0000 7f6381c00640 1 -- 172.21.15.16:0/101697981 wait complete. 2024-04-26T23:34:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.333+0000 7f7ddaa00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc00039b0 0x7f7ddc1e0fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc02a670 tx=0x7f7dcc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.334+0000 7fda9d600640 1 -- 172.21.15.16:0/1408482490 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98019070 con 0x7fdaa0142750 2024-04-26T23:34:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.334+0000 7f9a56000640 1 -- 172.21.15.16:0/4176349195 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a44037070 con 0x7f9a5806e4a0 2024-04-26T23:34:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.334+0000 7f7ba7400640 1 -- 172.21.15.16:0/2135973090 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94037070 con 0x7f7ba0038990 2024-04-26T23:34:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.334+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa01460d0 con 0x7fdaa0142750 2024-04-26T23:34:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.334+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa01e5460 con 0x7fdaa0142750 2024-04-26T23:34:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.334+0000 7fda9d600640 1 -- 172.21.15.16:0/1408482490 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9800cba0 con 0x7fdaa0142750 2024-04-26T23:34:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.334+0000 7fda9d600640 1 -- 172.21.15.16:0/1408482490 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98014440 con 0x7fdaa0142750 2024-04-26T23:34:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7fba49600640 1 -- 172.21.15.16:0/3381647100 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38037070 con 0x7fba4c14c270 2024-04-26T23:34:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7fba49600640 1 -- 172.21.15.16:0/3381647100 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3802abe0 con 0x7fba4c14c270 2024-04-26T23:34:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7fba49600640 1 -- 172.21.15.16:0/3381647100 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba440019f0 con 0x7fba4c14c270 2024-04-26T23:34:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7f6381c00640 1 Processor -- start 2024-04-26T23:34:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7f6381c00640 1 -- start start 2024-04-26T23:34:53.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7fba51a00640 1 -- 172.21.15.16:0/3381647100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c14c270 msgr2=0x7fba4c153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7f9a56000640 1 -- 172.21.15.16:0/4176349195 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a44032440 con 0x7f9a5806e4a0 2024-04-26T23:34:53.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7f7ba7400640 1 -- 172.21.15.16:0/2135973090 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9402ae10 con 0x7f7ba0038990 2024-04-26T23:34:53.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7f9a56000640 1 -- 172.21.15.16:0/4176349195 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a44032810 con 0x7f9a5806e4a0 2024-04-26T23:34:53.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7fba51a00640 1 --2- 172.21.15.16:0/3381647100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c14c270 0x7fba4c153e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba38009720 tx=0x7fba3802a0d0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7fba51a00640 1 -- 172.21.15.16:0/3381647100 shutdown_connections 2024-04-26T23:34:53.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7fba51a00640 1 --2- 172.21.15.16:0/3381647100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c14c270 0x7fba4c153e00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7fba51a00640 1 -- 172.21.15.16:0/3381647100 >> 172.21.15.16:0/3381647100 conn(0x7fba4c0686c0 msgr2=0x7fba4c0bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7f7dd3400640 1 -- 172.21.15.16:0/971969363 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc044070 con 0x7f7dc00039b0 2024-04-26T23:34:53.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7f7dd3400640 1 -- 172.21.15.16:0/971969363 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0049f0 con 0x7f7dc00039b0 2024-04-26T23:34:53.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7f7dd3400640 1 -- 172.21.15.16:0/971969363 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc004dc0 con 0x7f7dc00039b0 2024-04-26T23:34:53.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc1e1c40 con 0x7f7dc00039b0 2024-04-26T23:34:53.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.335+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc14b020 con 0x7f7dc00039b0 2024-04-26T23:34:53.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7fe8c6000640 1 -- 172.21.15.16:0/4041888799 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe8d00a2970 con 0x7fe8d009d270 2024-04-26T23:34:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7fba51a00640 1 -- 172.21.15.16:0/3381647100 shutdown_connections 2024-04-26T23:34:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7fba51a00640 1 -- 172.21.15.16:0/3381647100 wait complete. 2024-04-26T23:34:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.336+0000 7f7ba7400640 1 -- 172.21.15.16:0/2135973090 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94032660 con 0x7f7ba0038990 2024-04-26T23:34:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f6381c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f637c06eb10 0x7f637c09c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f6381c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b03e0 0x7f637c12f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f6381c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637c0b1760 0x7f637c071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc0693a0 con 0x7f7dc00039b0 2024-04-26T23:34:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f9a5e200640 1 -- 172.21.15.16:0/4176349195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 msgr2=0x7f9a580b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f9a5e200640 1 --2- 172.21.15.16:0/4176349195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a580b35f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a5806ec60 tx=0x7f9a4402a140 comp rx=0 tx=0).stop 2024-04-26T23:34:53.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f9a5e200640 1 -- 172.21.15.16:0/4176349195 shutdown_connections 2024-04-26T23:34:53.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f6381c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f637c0b0890 con 0x7f637c0b1760 2024-04-26T23:34:53.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f6381c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f637c0b5f10 con 0x7f637c06eb10 2024-04-26T23:34:53.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f6381c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f637c145590 con 0x7f637c0b03e0 2024-04-26T23:34:53.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.337+0000 7f9a5e200640 1 --2- 172.21.15.16:0/4176349195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a580b35f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f9a5e200640 1 --2- 172.21.15.16:0/4176349195 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a58150050 0x7f9a580b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f9a5e200640 1 --2- 172.21.15.16:0/4176349195 >> v2:172.21.15.32:3300/0 conn(0x7f9a5806e0c0 0x7f9a580af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f637aa00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f637c06eb10 0x7f637c09c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f9a5e200640 1 -- 172.21.15.16:0/4176349195 >> 172.21.15.16:0/4176349195 conn(0x7f9a580b6630 msgr2=0x7f9a580b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f7bae400640 1 -- 172.21.15.16:0/2135973090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0038990 msgr2=0x7f7ba00cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f7bae400640 1 --2- 172.21.15.16:0/2135973090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0038990 0x7f7ba00cc550 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ba003bf80 tx=0x7f7b9402a0c0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f637a000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b03e0 0x7f637c12f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f637a000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b03e0 0x7f637c12f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56808/0 (socket says 172.21.15.16:56808) 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7f637a000640 1 -- 172.21.15.16:0/691985380 learned_addr learned my addr 172.21.15.16:0/691985380 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.339+0000 7f637aa00640 1 -- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b03e0 msgr2=0x7f637c12f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.339+0000 7f637aa00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b03e0 0x7f637c12f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.339+0000 7f637aa00640 1 -- 172.21.15.16:0/691985380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637c0b1760 msgr2=0x7f637c071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.339+0000 7f637aa00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637c0b1760 0x7f637c071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.339+0000 7f637aa00640 1 -- 172.21.15.16:0/691985380 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c09bac0 con 0x7f637c06eb10 2024-04-26T23:34:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.339+0000 7f637a000640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b03e0 0x7f637c12f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:53.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f9a5e200640 1 -- 172.21.15.16:0/4176349195 shutdown_connections 2024-04-26T23:34:53.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7bae400640 1 -- 172.21.15.16:0/2135973090 shutdown_connections 2024-04-26T23:34:53.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.338+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c005290 con 0x7fdaa0142750 2024-04-26T23:34:53.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7bae400640 1 --2- 172.21.15.16:0/2135973090 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0039ab0 0x7f7ba003a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7bae400640 1 --2- 172.21.15.16:0/2135973090 >> v2:172.21.15.32:3300/0 conn(0x7f7ba003e090 0x7f7ba0039570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7bae400640 1 --2- 172.21.15.16:0/2135973090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0038990 0x7f7ba00cc550 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7bae400640 1 -- 172.21.15.16:0/2135973090 >> 172.21.15.16:0/2135973090 conn(0x7f7ba003eaa0 msgr2=0x7f7ba003eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.339+0000 7fba51a00640 1 Processor -- start 2024-04-26T23:34:53.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7dd3400640 1 -- 172.21.15.16:0/971969363 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7dcc030040 con 0x7f7dc00039b0 2024-04-26T23:34:53.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7bae400640 1 -- 172.21.15.16:0/2135973090 shutdown_connections 2024-04-26T23:34:53.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7fba51a00640 1 -- start start 2024-04-26T23:34:53.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.341+0000 7fda9d600640 1 -- 172.21.15.16:0/1408482490 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda9801c070 con 0x7fdaa0142750 2024-04-26T23:34:53.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.342+0000 7f637aa00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f637c06eb10 0x7f637c09c7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f637400ca80 tx=0x7f637400cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.342+0000 7fba51a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fba4c0be6e0 0x7fba4c1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.342+0000 7f6372a00640 1 -- 172.21.15.16:0/691985380 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374017070 con 0x7f637c06eb10 2024-04-26T23:34:53.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.342+0000 7f6372a00640 1 -- 172.21.15.16:0/691985380 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637400ac30 con 0x7f637c06eb10 2024-04-26T23:34:53.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.342+0000 7f6372a00640 1 -- 172.21.15.16:0/691985380 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374012620 con 0x7f637c06eb10 2024-04-26T23:34:53.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.342+0000 7fba51a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba4c14c270 0x7fba4c1dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7f9a5e200640 1 -- 172.21.15.16:0/4176349195 wait complete. 2024-04-26T23:34:53.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7fba51a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c1dd630 0x7fba4c1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.340+0000 7f7bae400640 1 -- 172.21.15.16:0/2135973090 wait complete. 2024-04-26T23:34:53.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7f7bae400640 1 Processor -- start 2024-04-26T23:34:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7f7dd3400640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7db806c970 0x7f7db806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7f7dd3400640 1 -- 172.21.15.16:0/971969363 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7dcc0aafc0 con 0x7f7dc00039b0 2024-04-26T23:34:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7fba4b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c1dd630 0x7fba4c1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7fba4b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c1dd630 0x7fba4c1ee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35434/0 (socket says 172.21.15.16:35434) 2024-04-26T23:34:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7fba4b400640 1 -- 172.21.15.16:0/90626340 learned_addr learned my addr 172.21.15.16:0/90626340 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7f7bae400640 1 -- start start 2024-04-26T23:34:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7fda9d600640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fda8006c8f0 0x7fda8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7f7dd3e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7db806c970 0x7f7db806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c0b6d80 con 0x7fba4c1dd630 2024-04-26T23:34:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c0b6c00 con 0x7fba4c14c270 2024-04-26T23:34:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.343+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c09cf50 con 0x7f637c06eb10 2024-04-26T23:34:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c09bd30 con 0x7f637c06eb10 2024-04-26T23:34:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7fda9d600640 1 -- 172.21.15.16:0/1408482490 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fda9808b830 con 0x7fdaa0142750 2024-04-26T23:34:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fba4c142880 con 0x7fba4c0be6e0 2024-04-26T23:34:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7fba4aa00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fba4c0be6e0 0x7fba4c1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7fba4a000640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba4c14c270 0x7fba4c1dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.344+0000 7fdaa5c00640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fda8006c8f0 0x7fda8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.345+0000 7fba4b400640 1 -- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fba4c0be6e0 msgr2=0x7fba4c1498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.345+0000 7fba4b400640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fba4c0be6e0 0x7fba4c1498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.345+0000 7fba4b400640 1 -- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba4c14c270 msgr2=0x7fba4c1dd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.345+0000 7fdaa5c00640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fda8006c8f0 0x7fda8006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda94034000 tx=0x7fda9402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.345+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637c0693a0 con 0x7f637c06eb10 2024-04-26T23:34:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.345+0000 7fba4b400640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba4c14c270 0x7fba4c1dd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7f7bae400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0038990 0x7f7ba000c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.345+0000 7fba4b400640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c140370 con 0x7fba4c1dd630 2024-04-26T23:34:53.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7f7bae400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0039ab0 0x7f7ba0165760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7fba4a000640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba4c14c270 0x7fba4c1dd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:53.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7f7bae400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ba00c8d10 0x7f7ba016f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7f7bad000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0038990 0x7f7ba000c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7f7ba7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0039ab0 0x7f7ba0165760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7f7bad000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0038990 0x7f7ba000c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56830/0 (socket says 172.21.15.16:56830) 2024-04-26T23:34:53.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.346+0000 7f7bad000640 1 -- 172.21.15.16:0/1324275939 learned_addr learned my addr 172.21.15.16:0/1324275939 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.347+0000 7f7dd3e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7db806c970 0x7f7db806ee30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc143d00 tx=0x7f7dc4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.347+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba003a920 con 0x7f7ba0039ab0 2024-04-26T23:34:53.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.347+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba003a7a0 con 0x7f7ba00c8d10 2024-04-26T23:34:53.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.347+0000 7fba4b400640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c1dd630 0x7fba4c1ee0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fba38009840 tx=0x7fba380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.347+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba003aaa0 con 0x7f7ba0038990 2024-04-26T23:34:53.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.347+0000 7f7bada00640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ba00c8d10 0x7f7ba016f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f9a5e200640 1 Processor -- start 2024-04-26T23:34:53.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f7dd3400640 1 -- 172.21.15.16:0/971969363 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7dcc079560 con 0x7f7dc00039b0 2024-04-26T23:34:53.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f9a5e200640 1 -- start start 2024-04-26T23:34:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f7ba7e00640 1 -- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0038990 msgr2=0x7f7ba000c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f7ba7e00640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0038990 0x7f7ba000c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f7ba7e00640 1 -- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ba00c8d10 msgr2=0x7f7ba016f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f7ba7e00640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ba00c8d10 0x7f7ba016f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f7ba7e00640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba000de20 con 0x7f7ba0039ab0 2024-04-26T23:34:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.348+0000 7f7bad000640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0038990 0x7f7ba000c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a5e200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a5806e0c0 0x7f9a5814bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a5e200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a5814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a5e200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a58150050 0x7f9a581e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a5e200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580b3b30 con 0x7f9a5806e4a0 2024-04-26T23:34:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a5e200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580aea70 con 0x7f9a58150050 2024-04-26T23:34:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a5e200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f9a580b3cb0 con 0x7f9a5806e0c0 2024-04-26T23:34:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a56a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a5814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a56a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a5814c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35448/0 (socket says 172.21.15.16:35448) 2024-04-26T23:34:53.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f9a56a00640 1 -- 172.21.15.16:0/2056468693 learned_addr learned my addr 172.21.15.16:0/2056468693 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:53.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f9a57400640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a5806e0c0 0x7f9a5814bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.349+0000 7f7ba7e00640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0039ab0 0x7f7ba0165760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00d520 tx=0x7f7b9c00d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f9a56a00640 1 -- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a5806e0c0 msgr2=0x7f9a5814bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f9a57e00640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a58150050 0x7f9a581e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f9a56a00640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a5806e0c0 0x7f9a5814bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f9a56a00640 1 -- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a58150050 msgr2=0x7f9a581e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f9a56a00640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a58150050 0x7f9a581e2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f9a56a00640 1 -- 172.21.15.16:0/2056468693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a581e2550 con 0x7f9a5806e4a0 2024-04-26T23:34:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.350+0000 7f6372a00640 1 -- 172.21.15.16:0/691985380 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f637401a070 con 0x7f637c06eb10 2024-04-26T23:34:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.351+0000 7f9a56a00640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a5814c2a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800c7f0 tx=0x7f9a4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.351+0000 7f6372a00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f635c06c8f0 0x7f635c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.352+0000 7f6372a00640 1 -- 172.21.15.16:0/691985380 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f637408bb90 con 0x7f637c06eb10 2024-04-26T23:34:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.352+0000 7f637a000640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f635c06c8f0 0x7f635c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.354+0000 7f637a000640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f635c06c8f0 0x7f635c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f636c035040 tx=0x7f636c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.354+0000 7f7ba4c00640 1 -- 172.21.15.16:0/1324275939 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0125f0 con 0x7f7ba0039ab0 2024-04-26T23:34:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.354+0000 7f9a4f400640 1 -- 172.21.15.16:0/2056468693 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48015070 con 0x7f9a5806e4a0 2024-04-26T23:34:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.354+0000 7f7ba4c00640 1 -- 172.21.15.16:0/1324275939 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c019070 con 0x7f7ba0039ab0 2024-04-26T23:34:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.354+0000 7f7ba4c00640 1 -- 172.21.15.16:0/1324275939 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0129b0 con 0x7f7ba0039ab0 2024-04-26T23:34:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7fba42a00640 1 -- 172.21.15.16:0/90626340 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38037040 con 0x7fba4c1dd630 2024-04-26T23:34:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7fba42a00640 1 -- 172.21.15.16:0/90626340 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba38004230 con 0x7fba4c1dd630 2024-04-26T23:34:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7f9a4f400640 1 -- 172.21.15.16:0/2056468693 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a48004220 con 0x7f9a5806e4a0 2024-04-26T23:34:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7f9a4f400640 1 -- 172.21.15.16:0/2056468693 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48007620 con 0x7f9a5806e4a0 2024-04-26T23:34:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5814a9f0 con 0x7f9a5806e4a0 2024-04-26T23:34:53.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a58149070 con 0x7f9a5806e4a0 2024-04-26T23:34:53.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7fba42a00640 1 -- 172.21.15.16:0/90626340 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38003610 con 0x7fba4c1dd630 2024-04-26T23:34:53.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7fda9d600640 1 -- 172.21.15.16:0/1408482490 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda98059600 con 0x7fdaa0142750 2024-04-26T23:34:53.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c14b2c0 con 0x7fba4c1dd630 2024-04-26T23:34:53.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.356+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c148280 con 0x7fba4c1dd630 2024-04-26T23:34:53.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.354+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba00c9230 con 0x7f7ba0039ab0 2024-04-26T23:34:53.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.355+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba00c9c60 con 0x7f7ba0039ab0 2024-04-26T23:34:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.356+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b84005290 con 0x7f7ba0039ab0 2024-04-26T23:34:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.357+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c149de0 con 0x7fba4c1dd630 2024-04-26T23:34:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.358+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a30005290 con 0x7f9a5806e4a0 2024-04-26T23:34:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.360+0000 7f7ba4c00640 1 -- 172.21.15.16:0/1324275939 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b9c012b50 con 0x7f7ba0039ab0 2024-04-26T23:34:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.360+0000 7fba42a00640 1 -- 172.21.15.16:0/90626340 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba380037b0 con 0x7fba4c1dd630 2024-04-26T23:34:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.362+0000 7fba42a00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fba2c06c940 0x7fba2c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.362+0000 7f7ba4c00640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b8806c9c0 0x7f7b8806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.362+0000 7f7ba4c00640 1 -- 172.21.15.16:0/1324275939 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7b9c08c6d0 con 0x7f7ba0039ab0 2024-04-26T23:34:53.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.362+0000 7f7bad000640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b8806c9c0 0x7f7b8806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.363+0000 7fba4aa00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fba2c06c940 0x7fba2c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.364+0000 7f7bad000640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b8806c9c0 0x7f7b8806ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b94035040 tx=0x7f7b9402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.364+0000 7fba4aa00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fba2c06c940 0x7fba2c06ee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba44001820 tx=0x7fba44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.366+0000 7f6372a00640 1 -- 172.21.15.16:0/691985380 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6374021020 con 0x7f637c06eb10 2024-04-26T23:34:53.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.366+0000 7f7ba4c00640 1 -- 172.21.15.16:0/1324275939 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7b9c05ab70 con 0x7f7ba0039ab0 2024-04-26T23:34:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.366+0000 7fba42a00640 1 -- 172.21.15.16:0/90626340 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fba38078a80 con 0x7fba4c1dd630 2024-04-26T23:34:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.369+0000 7f9a4f400640 1 -- 172.21.15.16:0/2056468693 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a480079d0 con 0x7f9a5806e4a0 2024-04-26T23:34:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.370+0000 7f9a4f400640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9a3806c9c0 0x7f9a3806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.371+0000 7f9a4f400640 1 -- 172.21.15.16:0/2056468693 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9a4808be80 con 0x7f9a5806e4a0 2024-04-26T23:34:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.371+0000 7f9a57400640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9a3806c9c0 0x7f9a3806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.373+0000 7f9a57400640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9a3806c9c0 0x7f9a3806ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a50003aa0 tx=0x7f9a50009830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.376+0000 7fba42a00640 1 -- 172.21.15.16:0/90626340 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fba3807b0e0 con 0x7fba4c1dd630 2024-04-26T23:34:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.381+0000 7f9a4f400640 1 -- 172.21.15.16:0/2056468693 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9a581e2550 con 0x7f9a5806e4a0 2024-04-26T23:34:53.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.779+0000 7f14aa800640 1 -- 172.21.15.16:0/274188480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1480005580 con 0x7f148c004800 2024-04-26T23:34:53.786 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T23:34:53.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.780+0000 7f1497400640 1 -- 172.21.15.16:0/274188480 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f149c061fc0 con 0x7f148c004800 2024-04-26T23:34:53.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.786+0000 7f1494c00640 1 -- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f148406c920 msgr2=0x7f148406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.786+0000 7f1494c00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f148406c920 0x7f148406ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1498032000 tx=0x7f1498005000 comp rx=0 tx=0).stop 2024-04-26T23:34:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.786+0000 7f1494c00640 1 -- 172.21.15.16:0/274188480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 msgr2=0x7f14a40a24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.786+0000 7f1494c00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f14a40a24c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f149c001ae0 tx=0x7f149c00d8c0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.786+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe8d00ba3a0 con 0x7fe8d009d270 2024-04-26T23:34:53.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.787+0000 7f1494c00640 1 -- 172.21.15.16:0/274188480 shutdown_connections 2024-04-26T23:34:53.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.787+0000 7f1494c00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f148406c920 0x7f148406ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.787+0000 7f1494c00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f14a41dcfc0 0x7f14a40b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.787+0000 7f1494c00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f14a41dcb40 0x7f14a40b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.787+0000 7f1494c00640 1 --2- 172.21.15.16:0/274188480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f148c004800 0x7f14a40a24c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.787+0000 7f1494c00640 1 -- 172.21.15.16:0/274188480 >> 172.21.15.16:0/274188480 conn(0x7f14a409fa50 msgr2=0x7f14a413f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.787+0000 7fe8c6000640 1 -- 172.21.15.16:0/4041888799 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8d00a2970 con 0x7fe8d009d270 2024-04-26T23:34:53.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.788+0000 7f1494c00640 1 -- 172.21.15.16:0/274188480 shutdown_connections 2024-04-26T23:34:53.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.788+0000 7f1494c00640 1 -- 172.21.15.16:0/274188480 wait complete. 2024-04-26T23:34:53.793 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T23:34:53.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.792+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe8b006c8f0 msgr2=0x7fe8b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.792+0000 7fe8cf200640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe8b006c8f0 0x7fe8b006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005520 tx=0x7fe8c8009040 comp rx=0 tx=0).stop 2024-04-26T23:34:53.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.792+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 msgr2=0x7fe8d00a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.792+0000 7fe8cf200640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d00a2430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d800 tx=0x7fe8c000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.793+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 shutdown_connections 2024-04-26T23:34:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.793+0000 7fe8cf200640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe8b006c8f0 0x7fe8b006edb0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005520 tx=0x7fe8c8009040 comp rx=0 tx=0).stop 2024-04-26T23:34:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.793+0000 7fe8cf200640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8d0142920 0x7fe8d00b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.793+0000 7fe8cf200640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d009d270 0x7fe8d00a2430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.793+0000 7fe8cf200640 1 --2- 172.21.15.16:0/4041888799 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe8d009be20 0x7fe8d00b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.793+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 >> 172.21.15.16:0/4041888799 conn(0x7fe8d009fa50 msgr2=0x7fe8d00ba5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.794+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 shutdown_connections 2024-04-26T23:34:53.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.794+0000 7fe8cf200640 1 -- 172.21.15.16:0/4041888799 wait complete. 2024-04-26T23:34:53.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.797+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7ddc0be0c0 con 0x7f7dc00039b0 2024-04-26T23:34:53.805 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T23:34:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.798+0000 7f7dd3400640 1 -- 172.21.15.16:0/971969363 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7dcc078e60 con 0x7f7dc00039b0 2024-04-26T23:34:53.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.803+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7db806c970 msgr2=0x7f7db806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.803+0000 7f7de1e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7db806c970 0x7f7db806ee30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc143d00 tx=0x7f7dc4008040 comp rx=0 tx=0).stop 2024-04-26T23:34:53.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.803+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc00039b0 msgr2=0x7f7ddc1e0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.803+0000 7f7de1e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc00039b0 0x7f7ddc1e0fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc02a670 tx=0x7f7dcc001120 comp rx=0 tx=0).stop 2024-04-26T23:34:53.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.806+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 shutdown_connections 2024-04-26T23:34:53.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.806+0000 7f7de1e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7db806c970 0x7f7db806ee30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.806+0000 7f7de1e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ddc1d7e30 0x7f7ddc1dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.806+0000 7f7de1e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ddc142d60 0x7f7ddc1d78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.806+0000 7f7de1e00640 1 --2- 172.21.15.16:0/971969363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dc00039b0 0x7f7ddc1e0fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.806+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 >> 172.21.15.16:0/971969363 conn(0x7f7ddc0686c0 msgr2=0x7f7ddc0b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.807+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 shutdown_connections 2024-04-26T23:34:53.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.807+0000 7f7de1e00640 1 -- 172.21.15.16:0/971969363 wait complete. 2024-04-26T23:34:53.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.810+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fda7c005580 con 0x7fdaa0142750 2024-04-26T23:34:53.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.811+0000 7fda9d600640 1 -- 172.21.15.16:0/1408482490 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda9805d900 con 0x7fdaa0142750 2024-04-26T23:34:53.817 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T23:34:53.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.814+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7b84005850 con 0x7f7ba0039ab0 2024-04-26T23:34:53.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.815+0000 7f7ba4c00640 1 -- 172.21.15.16:0/1324275939 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b9c05a470 con 0x7f7ba0039ab0 2024-04-26T23:34:53.819 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:53.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fda8006c8f0 msgr2=0x7fda8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fda8006c8f0 0x7fda8006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda94034000 tx=0x7fda9402e000 comp rx=0 tx=0).stop 2024-04-26T23:34:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa0142750 msgr2=0x7fdaa0149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa0142750 0x7fdaa0149f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda9800b990 tx=0x7fda9800be50 comp rx=0 tx=0).stop 2024-04-26T23:34:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 shutdown_connections 2024-04-26T23:34:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fda8006c8f0 0x7fda8006edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaa009d270 0x7fdaa01e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdaa0142750 0x7fdaa0149f00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 --2- 172.21.15.16:0/1408482490 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fdaa009be20 0x7fdaa014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.817+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 >> 172.21.15.16:0/1408482490 conn(0x7fdaa009fa50 msgr2=0x7fdaa0073770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-04-26T23:34:53.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.818+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 shutdown_connections 2024-04-26T23:34:53.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.818+0000 7fdaa7000640 1 -- 172.21.15.16:0/1408482490 wait complete. 2024-04-26T23:34:53.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.818+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b8806c9c0 msgr2=0x7f7b8806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.818+0000 7f7bae400640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b8806c9c0 0x7f7b8806ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b94035040 tx=0x7f7b9402e000 comp rx=0 tx=0).stop 2024-04-26T23:34:53.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.819+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0039ab0 msgr2=0x7f7ba0165760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.819+0000 7f7bae400640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0039ab0 0x7f7ba0165760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00d520 tx=0x7f7b9c00d920 comp rx=0 tx=0).stop 2024-04-26T23:34:53.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.819+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f637c0b6b40 con 0x7f637c06eb10 2024-04-26T23:34:53.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 shutdown_connections 2024-04-26T23:34:53.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b8806c9c0 0x7f7b8806ee80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ba00c8d10 0x7f7ba016f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ba0039ab0 0x7f7ba0165760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 --2- 172.21.15.16:0/1324275939 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7ba0038990 0x7f7ba000c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 >> 172.21.15.16:0/1324275939 conn(0x7f7ba003eaa0 msgr2=0x7f7ba0006530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 shutdown_connections 2024-04-26T23:34:53.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f7bae400640 1 -- 172.21.15.16:0/1324275939 wait complete. 2024-04-26T23:34:53.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.820+0000 7f6372a00640 1 -- 172.21.15.16:0/691985380 <== mon.1 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f637400ae20 con 0x7f637c06eb10 2024-04-26T23:34:53.825 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T23:34:53.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.821+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fba4c0693a0 con 0x7fba4c1dd630 2024-04-26T23:34:53.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.822+0000 7fba42a00640 1 -- 172.21.15.16:0/90626340 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba3807a9e0 con 0x7fba4c1dd630 2024-04-26T23:34:53.826 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T23:34:53.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.824+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f635c06c8f0 msgr2=0x7f635c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.824+0000 7f6381c00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f635c06c8f0 0x7f635c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f636c035040 tx=0x7f636c02e000 comp rx=0 tx=0).stop 2024-04-26T23:34:53.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.824+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f637c06eb10 msgr2=0x7f637c09c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.824+0000 7f6381c00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f637c06eb10 0x7f637c09c7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f637400ca80 tx=0x7f637400cf40 comp rx=0 tx=0).stop 2024-04-26T23:34:53.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-04-26T23:34:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 shutdown_connections 2024-04-26T23:34:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f635c06c8f0 0x7f635c06edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637c0b1760 0x7f637c071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f637c0b03e0 0x7f637c12f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 --2- 172.21.15.16:0/691985380 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f637c06eb10 0x7f637c09c7b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 >> 172.21.15.16:0/691985380 conn(0x7f637c0b6630 msgr2=0x7f637c0b8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fba2c06c940 msgr2=0x7fba2c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fba2c06c940 0x7fba2c06ee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba44001820 tx=0x7fba44009040 comp rx=0 tx=0).stop 2024-04-26T23:34:53.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c1dd630 msgr2=0x7fba4c1ee0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c1dd630 0x7fba4c1ee0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fba38009840 tx=0x7fba380046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 shutdown_connections 2024-04-26T23:34:53.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7f6381c00640 1 -- 172.21.15.16:0/691985380 wait complete. 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 shutdown_connections 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fba2c06c940 0x7fba2c06ee00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba4c14c270 0x7fba4c1dd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba4c1dd630 0x7fba4c1ee0e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 --2- 172.21.15.16:0/90626340 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fba4c0be6e0 0x7fba4c1498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.825+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 >> 172.21.15.16:0/90626340 conn(0x7fba4c0686c0 msgr2=0x7fba4c0bcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.826+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 shutdown_connections 2024-04-26T23:34:53.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.826+0000 7fba51a00640 1 -- 172.21.15.16:0/90626340 wait complete. 2024-04-26T23:34:53.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.830+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9a30005850 con 0x7f9a5806e4a0 2024-04-26T23:34:53.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.831+0000 7f9a4f400640 1 -- 172.21.15.16:0/2056468693 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a48059cd0 con 0x7f9a5806e4a0 2024-04-26T23:34:53.835 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T23:34:53.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-04-26T23:34:53.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9a3806c9c0 msgr2=0x7f9a3806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9a3806c9c0 0x7f9a3806ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a50003aa0 tx=0x7f9a50009830 comp rx=0 tx=0).stop 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 msgr2=0x7f9a5814c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a5814c2a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a4800c7f0 tx=0x7f9a4800ccb0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 shutdown_connections 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9a3806c9c0 0x7f9a3806ee80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9a58150050 0x7f9a581e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5806e4a0 0x7f9a5814c2a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 --2- 172.21.15.16:0/2056468693 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9a5806e0c0 0x7f9a5814bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 >> 172.21.15.16:0/2056468693 conn(0x7f9a580b6630 msgr2=0x7f9a580b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 shutdown_connections 2024-04-26T23:34:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:53.834+0000 7f9a5e200640 1 -- 172.21.15.16:0/2056468693 wait complete. 2024-04-26T23:34:53.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-04-26T23:34:53.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-04-26T23:34:53.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-04-26T23:34:53.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-04-26T23:34:53.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-04-26T23:34:54.823 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:34:54.829 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:34:54.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:34:54.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:34:54.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:34:54.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:34:54.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:34:54.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:34:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.088+0000 7f775d000640 1 Processor -- start 2024-04-26T23:34:55.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.088+0000 7f775d000640 1 -- start start 2024-04-26T23:34:55.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.090+0000 7f775d000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f77500377f0 0x7f7750039690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.090+0000 7f775d000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500f2b20 0x7f77500f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.091+0000 7f7757400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7750036a00 0x7f7750035e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32876/0 (socket says 172.21.15.16:32876) 2024-04-26T23:34:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.091+0000 7f7757400640 1 -- 172.21.15.16:0/4151065783 learned_addr learned my addr 172.21.15.16:0/4151065783 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.091+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750035420 con 0x7f7750036a00 2024-04-26T23:34:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.091+0000 7f7756a00640 1 --2- 172.21.15.16:0/4151065783 >> v2:172.21.15.32:3300/0 conn(0x7f77500377f0 0x7f7750039690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.091+0000 7f7757e00640 1 --2- 172.21.15.16:0/4151065783 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500f2b20 0x7f77500f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.093+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f77500eab40 con 0x7f77500377f0 2024-04-26T23:34:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.093+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f77500ea7d0 con 0x7f77500f2b20 2024-04-26T23:34:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.093+0000 7f7756000640 1 -- 172.21.15.16:0/4151065783 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160759422 0 0) 0x7f7750035420 con 0x7f7750036a00 2024-04-26T23:34:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.093+0000 7f7756000640 1 -- 172.21.15.16:0/4151065783 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7740003520 con 0x7f7750036a00 2024-04-26T23:34:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.094+0000 7f7757e00640 1 -- 172.21.15.16:0/4151065783 >> v2:172.21.15.32:3300/0 conn(0x7f77500377f0 msgr2=0x7f7750039690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.094+0000 7f7757e00640 1 --2- 172.21.15.16:0/4151065783 >> v2:172.21.15.32:3300/0 conn(0x7f77500377f0 0x7f7750039690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.094+0000 7f7757e00640 1 -- 172.21.15.16:0/4151065783 >> v1:172.21.15.16:6789/0 conn(0x7f7750036a00 legacy=0x7f7750035e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.094+0000 7f7757e00640 1 -- 172.21.15.16:0/4151065783 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7750036ff0 con 0x7f77500f2b20 2024-04-26T23:34:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.095+0000 7f7757e00640 1 --2- 172.21.15.16:0/4151065783 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500f2b20 0x7f77500f4f10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7758000b60 tx=0x7f7758097680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c02d14869e9ed06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.096+0000 7f7756000640 1 -- 172.21.15.16:0/4151065783 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775806e8a0 con 0x7f77500f2b20 2024-04-26T23:34:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.096+0000 7f7756000640 1 -- 172.21.15.16:0/4151065783 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775806ea40 con 0x7f77500f2b20 2024-04-26T23:34:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.096+0000 7f7756000640 1 -- 172.21.15.16:0/4151065783 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775806ee10 con 0x7f77500f2b20 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500f2b20 msgr2=0x7f77500f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 --2- 172.21.15.16:0/4151065783 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500f2b20 0x7f77500f4f10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7758000b60 tx=0x7f7758097680 comp rx=0 tx=0).stop 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 shutdown_connections 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 --2- 172.21.15.16:0/4151065783 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500f2b20 0x7f77500f4f10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 --2- 172.21.15.16:0/4151065783 >> v2:172.21.15.32:3300/0 conn(0x7f77500377f0 0x7f7750039690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 >> 172.21.15.16:0/4151065783 conn(0x7f775003a8a0 msgr2=0x7f775003acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 shutdown_connections 2024-04-26T23:34:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.097+0000 7f775d000640 1 -- 172.21.15.16:0/4151065783 wait complete. 2024-04-26T23:34:55.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.099+0000 7f7a9fe00640 1 Processor -- start 2024-04-26T23:34:55.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.099+0000 7f7a9fe00640 1 -- start start 2024-04-26T23:34:55.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.101+0000 7f7a9fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7aa00bba70 0x7f7aa0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.101+0000 7f7a9fe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa00bbf00 con 0x7f7aa009fae0 2024-04-26T23:34:55.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.101+0000 7f7a9fe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa009fec0 con 0x7f7aa009cb00 2024-04-26T23:34:55.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.101+0000 7f7a9fe00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa009c250 con 0x7f7aa00bba70 2024-04-26T23:34:55.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.101+0000 7f775d000640 1 Processor -- start 2024-04-26T23:34:55.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.102+0000 7f775d000640 1 -- start start 2024-04-26T23:34:55.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.102+0000 7f7a9f400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7aa00bba70 0x7f7aa0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.102+0000 7f7a9e000640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7aa009cb00 0x7f7aa0142430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:50544/0 (socket says 172.21.15.16:50544) 2024-04-26T23:34:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.102+0000 7f7a9e000640 1 -- 172.21.15.16:0/663532232 learned_addr learned my addr 172.21.15.16:0/663532232 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.103+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449183215 0 0) 0x7f7aa00bbf00 con 0x7f7aa009fae0 2024-04-26T23:34:55.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.103+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a84003520 con 0x7f7aa009fae0 2024-04-26T23:34:55.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.103+0000 7f775d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7750036a00 0x7f77500edd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1083340700 0 0) 0x7f7a84003520 con 0x7f7aa009fae0 2024-04-26T23:34:55.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 >> v2:172.21.15.32:3300/0 conn(0x7f7aa00bba70 msgr2=0x7f7aa0153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 --2- 172.21.15.16:0/663532232 >> v2:172.21.15.32:3300/0 conn(0x7f7aa00bba70 0x7f7aa0153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 >> v1:172.21.15.32:6789/0 conn(0x7f7aa009cb00 legacy=0x7f7aa0142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa00bd730 con 0x7f7aa009fae0 2024-04-26T23:34:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f775d000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500377f0 0x7f77500e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f7a88001650 con 0x7f7aa009fae0 2024-04-26T23:34:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 >> v1:172.21.15.16:6789/0 conn(0x7f7aa009fae0 legacy=0x7f7aa009bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7a84003a10 0x7f7a84003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7a84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a840052e0 0x7f7a8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa009c250 con 0x7f7a84004800 2024-04-26T23:34:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84014a40 con 0x7f7a840052e0 2024-04-26T23:34:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.104+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7a84014c40 con 0x7f7a84003a10 2024-04-26T23:34:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.105+0000 7f775d000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77500f2b20 0x7f77500e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.105+0000 7f7757400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7750036a00 0x7f77500edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.105+0000 7f7757400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7750036a00 0x7f77500edd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35454/0 (socket says 172.21.15.16:35454) 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.106+0000 7f775d000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77500359f0 con 0x7f7750036a00 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.106+0000 7f775d000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7750035870 con 0x7f77500f2b20 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.106+0000 7f775d000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7750038380 con 0x7f77500377f0 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.105+0000 7f7756a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500377f0 0x7f77500e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.106+0000 7f7756a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500377f0 0x7f77500e6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56846/0 (socket says 172.21.15.16:56846) 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.106+0000 7f7756a00640 1 -- 172.21.15.16:0/2993745961 learned_addr learned my addr 172.21.15.16:0/2993745961 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.106+0000 7f7a9e000640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7a84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.107+0000 7f7757400640 1 -- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500377f0 msgr2=0x7f77500e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.107+0000 7f7757400640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500377f0 0x7f77500e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.107+0000 7f7757400640 1 -- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77500f2b20 msgr2=0x7f77500e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.107+0000 7f7757400640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77500f2b20 0x7f77500e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.107+0000 7f7757400640 1 -- 172.21.15.16:0/2993745961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77500e4d30 con 0x7f7750036a00 2024-04-26T23:34:55.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.107+0000 7f7a9e000640 1 -- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7a84003a10 msgr2=0x7f7a84003e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:34:55.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7757400640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7750036a00 0x7f77500edd70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f774400c3e0 tx=0x7f774400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7a9e000640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7a84003a10 0x7f7a84003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7a9e000640 1 -- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a840052e0 msgr2=0x7f7a8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7a9f400640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a840052e0 0x7f7a8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f774b400640 1 -- 172.21.15.16:0/2993745961 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440074e0 con 0x7f7750036a00 2024-04-26T23:34:55.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7a9e000640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a840052e0 0x7f7a8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f774b400640 1 -- 172.21.15.16:0/2993745961 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77440047e0 con 0x7f7750036a00 2024-04-26T23:34:55.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f774b400640 1 -- 172.21.15.16:0/2993745961 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744004bf0 con 0x7f7750036a00 2024-04-26T23:34:55.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.109+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77500e6b30 con 0x7f7750036a00 2024-04-26T23:34:55.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.109+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77500e6840 con 0x7f7750036a00 2024-04-26T23:34:55.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7a9e000640 1 -- 172.21.15.16:0/663532232 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a84014f00 con 0x7f7a84004800 2024-04-26T23:34:55.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7a9f400640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7a840052e0 0x7f7a8400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:55.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.108+0000 7f7a9f400640 1 -- 172.21.15.16:0/663532232 reap_dead start 2024-04-26T23:34:55.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.110+0000 7f7a9e000640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7a84004c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7aa009cf40 tx=0x7f7a84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcacfd138fc1f93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.113+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90035070 con 0x7f7a84004800 2024-04-26T23:34:55.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.113+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9002c040 con 0x7f7a84004800 2024-04-26T23:34:55.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.114+0000 7f7a9d600640 1 -- 172.21.15.16:0/663532232 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90035070 con 0x7f7a84004800 2024-04-26T23:34:55.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.114+0000 7f7a9fe00640 1 -- 172.21.15.16:0/663532232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 msgr2=0x7f7a84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.114+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7a84004c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7aa009cf40 tx=0x7f7a84005830 comp rx=0 tx=0).stop 2024-04-26T23:34:55.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.115+0000 7f774b400640 1 -- 172.21.15.16:0/2993745961 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7744011070 con 0x7f7750036a00 2024-04-26T23:34:55.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.115+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77500052c0 con 0x7f7750036a00 2024-04-26T23:34:55.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.116+0000 7f7a9fe00640 1 -- 172.21.15.16:0/663532232 shutdown_connections 2024-04-26T23:34:55.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.116+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/663532232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7a84004c80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.116+0000 7f7a9fe00640 1 -- 172.21.15.16:0/663532232 >> 172.21.15.16:0/663532232 conn(0x7f7aa00bdc90 msgr2=0x7f7aa00be070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.116+0000 7f774b400640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f773806c9c0 0x7f773806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.117+0000 7f774b400640 1 -- 172.21.15.16:0/2993745961 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f774408b670 con 0x7f7750036a00 2024-04-26T23:34:55.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.118+0000 7f7756a00640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f773806c9c0 0x7f773806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.119+0000 7f7756a00640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f773806c9c0 0x7f773806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77500dccc0 tx=0x7f774c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.120+0000 7f7a9fe00640 1 -- 172.21.15.16:0/663532232 shutdown_connections 2024-04-26T23:34:55.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.120+0000 7f7a9fe00640 1 -- 172.21.15.16:0/663532232 wait complete. 2024-04-26T23:34:55.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.124+0000 7f7a9fe00640 1 Processor -- start 2024-04-26T23:34:55.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.124+0000 7f7a9fe00640 1 -- start start 2024-04-26T23:34:55.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f774b400640 1 -- 172.21.15.16:0/2993745961 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f77500e4d30 con 0x7f7750036a00 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7aa0141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7aa01d9680 0x7f7aa01d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7aa0149e90 0x7f7aa014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f7a9fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa00ba2d0 con 0x7f7a84004800 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f7a9fe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa00b9e40 con 0x7f7aa0149e90 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f7a9fe00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa01da0b0 con 0x7f7aa01d9680 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.126+0000 7f7a9e000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7aa01d9680 0x7f7aa01d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.127+0000 7f7a9e000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7aa01d9680 0x7f7aa01d9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56858/0 (socket says 172.21.15.16:56858) 2024-04-26T23:34:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.127+0000 7f7a9e000640 1 -- 172.21.15.16:0/315039372 learned_addr learned my addr 172.21.15.16:0/315039372 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.127+0000 7f7a9f400640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7aa0149e90 0x7f7aa014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.128+0000 7f7a9ea00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7aa0141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.128+0000 7f7a9e000640 1 -- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7aa0149e90 msgr2=0x7f7aa014a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.128+0000 7f7a9e000640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7aa0149e90 0x7f7aa014a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.128+0000 7f7a9e000640 1 -- 172.21.15.16:0/315039372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 msgr2=0x7f7aa0141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.128+0000 7f7a9e000640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7aa0141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.128+0000 7f7a9e000640 1 -- 172.21.15.16:0/315039372 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa0149690 con 0x7f7aa01d9680 2024-04-26T23:34:55.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.138+0000 7f7a9e000640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7aa01d9680 0x7f7aa01d9ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a9002af50 tx=0x7f7a900014a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.145+0000 7f7a96a00640 1 -- 172.21.15.16:0/315039372 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90040020 con 0x7f7aa01d9680 2024-04-26T23:34:55.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.145+0000 7f7a96a00640 1 -- 172.21.15.16:0/315039372 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a90036040 con 0x7f7aa01d9680 2024-04-26T23:34:55.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.145+0000 7f7a96a00640 1 -- 172.21.15.16:0/315039372 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90035070 con 0x7f7aa01d9680 2024-04-26T23:34:55.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.145+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa0149970 con 0x7f7aa01d9680 2024-04-26T23:34:55.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.146+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa014be70 con 0x7f7aa01d9680 2024-04-26T23:34:55.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.150+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa0069620 con 0x7f7aa01d9680 2024-04-26T23:34:55.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.150+0000 7f7a96a00640 1 -- 172.21.15.16:0/315039372 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a90043020 con 0x7f7aa01d9680 2024-04-26T23:34:55.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.152+0000 7f7a96a00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7a7c06c9c0 0x7f7a7c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.152+0000 7f7a96a00640 1 -- 172.21.15.16:0/315039372 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7a900ac1b0 con 0x7f7aa01d9680 2024-04-26T23:34:55.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.153+0000 7f7a9ea00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7a7c06c9c0 0x7f7a7c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.154+0000 7f7a9ea00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7a7c06c9c0 0x7f7a7c06ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a88001050 tx=0x7f7a88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.158+0000 7facd1e00640 1 Processor -- start 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.159+0000 7facd1e00640 1 -- start start 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.160+0000 7facd1e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faccc0be6e0 0x7faccc14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.160+0000 7facd1e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faccc0ba3f0 0x7faccc14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.160+0000 7facd1e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faccc0beac0 con 0x7faccc142170 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.160+0000 7facd1e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7faccc0b57c0 con 0x7faccc0ba3f0 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.160+0000 7facd1e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7faccc0b5aa0 con 0x7faccc0be6e0 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.161+0000 7facca000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faccc0ba3f0 0x7faccc14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.161+0000 7faccaa00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faccc0be6e0 0x7faccc14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.161+0000 7faccb400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faccc142170 0x7faccc1425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:50560/0 (socket says 172.21.15.16:50560) 2024-04-26T23:34:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.161+0000 7faccb400640 1 -- 172.21.15.16:0/1295577177 learned_addr learned my addr 172.21.15.16:0/1295577177 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:55.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.162+0000 7facca000640 1 -- 172.21.15.16:0/1295577177 >> v2:172.21.15.32:3300/0 conn(0x7faccc0be6e0 msgr2=0x7faccc14bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.162+0000 7facca000640 1 --2- 172.21.15.16:0/1295577177 >> v2:172.21.15.32:3300/0 conn(0x7faccc0be6e0 0x7faccc14bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.162+0000 7facca000640 1 -- 172.21.15.16:0/1295577177 >> v1:172.21.15.32:6789/0 conn(0x7faccc142170 legacy=0x7faccc1425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.162+0000 7facca000640 1 -- 172.21.15.16:0/1295577177 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faccc0b5d80 con 0x7faccc0ba3f0 2024-04-26T23:34:55.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.163+0000 7facca000640 1 --2- 172.21.15.16:0/1295577177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc0ba3f0 0x7faccc14c0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faccc06d9b0 tx=0x7facbc02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bca85af6af433dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.163+0000 7facc9600640 1 -- 172.21.15.16:0/1295577177 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc037070 con 0x7faccc0ba3f0 2024-04-26T23:34:55.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.164+0000 7facc9600640 1 -- 172.21.15.16:0/1295577177 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facbc032440 con 0x7faccc0ba3f0 2024-04-26T23:34:55.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.164+0000 7facc9600640 1 -- 172.21.15.16:0/1295577177 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc032810 con 0x7faccc0ba3f0 2024-04-26T23:34:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.165+0000 7facd1e00640 1 -- 172.21.15.16:0/1295577177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc0ba3f0 msgr2=0x7faccc14c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.165+0000 7facd1e00640 1 --2- 172.21.15.16:0/1295577177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc0ba3f0 0x7faccc14c0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faccc06d9b0 tx=0x7facbc02a150 comp rx=0 tx=0).stop 2024-04-26T23:34:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.165+0000 7facd1e00640 1 -- 172.21.15.16:0/1295577177 shutdown_connections 2024-04-26T23:34:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.165+0000 7facd1e00640 1 --2- 172.21.15.16:0/1295577177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc0ba3f0 0x7faccc14c0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.165+0000 7facd1e00640 1 --2- 172.21.15.16:0/1295577177 >> v2:172.21.15.32:3300/0 conn(0x7faccc0be6e0 0x7faccc14bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.165+0000 7facd1e00640 1 -- 172.21.15.16:0/1295577177 >> 172.21.15.16:0/1295577177 conn(0x7faccc0686c0 msgr2=0x7faccc0bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.166+0000 7facd1e00640 1 -- 172.21.15.16:0/1295577177 shutdown_connections 2024-04-26T23:34:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.167+0000 7ff690a00640 1 Processor -- start 2024-04-26T23:34:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.167+0000 7ff690a00640 1 -- start start 2024-04-26T23:34:55.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.166+0000 7facd1e00640 1 -- 172.21.15.16:0/1295577177 wait complete. 2024-04-26T23:34:55.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.169+0000 7facd1e00640 1 Processor -- start 2024-04-26T23:34:55.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.169+0000 7f7a96a00640 1 -- 172.21.15.16:0/315039372 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7a9004a030 con 0x7f7aa01d9680 2024-04-26T23:34:55.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.169+0000 7facd1e00640 1 -- start start 2024-04-26T23:34:55.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.170+0000 7f90f9400640 1 Processor -- start 2024-04-26T23:34:55.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.170+0000 7ff690a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff68c146d10 0x7ff68c0b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.170+0000 7ffaab600640 1 Processor -- start 2024-04-26T23:34:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.171+0000 7ffaab600640 1 -- start start 2024-04-26T23:34:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.171+0000 7facd1e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7faccc0be6e0 0x7faccc140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.171+0000 7ff68a800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff68c0b7390 0x7ff68c0b58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32906/0 (socket says 172.21.15.16:32906) 2024-04-26T23:34:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.171+0000 7ff68a800640 1 -- 172.21.15.16:0/878391871 learned_addr learned my addr 172.21.15.16:0/878391871 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.171+0000 7facd1e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faccc142170 0x7faccc1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.171+0000 7facd1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc1e1560 0x7faccc1e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7facd1e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faccc0b6d80 con 0x7faccc1e1560 2024-04-26T23:34:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7faccaa00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7faccc0be6e0 0x7faccc140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.170+0000 7f90f9400640 1 -- start start 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f90f40be6e0 0x7f90f414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f9400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f90f40ba3f0 0x7f90f414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f9400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f4142170 0x7f90f41425b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f9400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f90f40beac0 con 0x7f90f40be6e0 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f9400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f90f40b57c0 con 0x7f90f40ba3f0 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f9400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f90f40b5aa0 con 0x7f90f4142170 2024-04-26T23:34:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ffaab600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffaa40be7e0 0x7ffaa414ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7facca000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faccc142170 0x7faccc1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7faccb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc1e1560 0x7faccc1e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7faccb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc1e1560 0x7faccc1e1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35488/0 (socket says 172.21.15.16:35488) 2024-04-26T23:34:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7faccb400640 1 -- 172.21.15.16:0/1025616684 learned_addr learned my addr 172.21.15.16:0/1025616684 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ffaab600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffaa40b6a10 0x7ffaa4142020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ffaab600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa40bebc0 con 0x7ffaa4142560 2024-04-26T23:34:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ffaab600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa40b59c0 con 0x7ffaa40be7e0 2024-04-26T23:34:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ffaab600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa41429a0 con 0x7ffaa40b6a10 2024-04-26T23:34:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c072c10 con 0x7ff68c0b7390 2024-04-26T23:34:55.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c072eb0 con 0x7ff68c073a30 2024-04-26T23:34:55.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff68c0b5fe0 con 0x7ff68c146d10 2024-04-26T23:34:55.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f3200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f4142170 0x7f90f41425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f90f40be6e0 0x7f90f414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7f90f3200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f4142170 0x7f90f41425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56890/0 (socket says 172.21.15.16:56890) 2024-04-26T23:34:55.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7f90f3200640 1 -- 172.21.15.16:0/980246681 learned_addr learned my addr 172.21.15.16:0/980246681 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffaa40b6a10 0x7ffaa4142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa8c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffaa40be7e0 0x7ffaa414ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffaa40b6a10 0x7ffaa4142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:54444/0 (socket says 172.21.15.16:54444) 2024-04-26T23:34:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa3e00640 1 -- 172.21.15.16:0/3516960325 learned_addr learned my addr 172.21.15.16:0/3516960325 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.172+0000 7ff68b200640 1 --2- 172.21.15.16:0/878391871 >> v2:172.21.15.16:3300/0 conn(0x7ff68c146d10 0x7ff68c0b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7f90f1e00640 1 --2- 172.21.15.16:0/980246681 >> v2:172.21.15.32:3300/0 conn(0x7f90f40ba3f0 0x7f90f414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7f90f3200640 1 -- 172.21.15.16:0/980246681 >> v2:172.21.15.32:3300/0 conn(0x7f90f40ba3f0 msgr2=0x7f90f414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7f90f3200640 1 --2- 172.21.15.16:0/980246681 >> v2:172.21.15.32:3300/0 conn(0x7f90f40ba3f0 0x7f90f414c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7f90f3200640 1 -- 172.21.15.16:0/980246681 >> v2:172.21.15.16:3300/0 conn(0x7f90f40be6e0 msgr2=0x7f90f414bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7f90f3200640 1 --2- 172.21.15.16:0/980246681 >> v2:172.21.15.16:3300/0 conn(0x7f90f40be6e0 0x7f90f414bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7f90f3200640 1 -- 172.21.15.16:0/980246681 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f40b5d80 con 0x7f90f4142170 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7faccc0b6c00 con 0x7faccc142170 2024-04-26T23:34:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7faccc152df0 con 0x7faccc0be6e0 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa3e00640 1 -- 172.21.15.16:0/3516960325 >> v2:172.21.15.16:3300/0 conn(0x7ffaa40be7e0 msgr2=0x7ffaa414ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa3e00640 1 --2- 172.21.15.16:0/3516960325 >> v2:172.21.15.16:3300/0 conn(0x7ffaa40be7e0 0x7ffaa414ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa3e00640 1 -- 172.21.15.16:0/3516960325 >> v1:172.21.15.16:6789/0 conn(0x7ffaa4142560 legacy=0x7ffaa40b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.173+0000 7ffaa3e00640 1 -- 172.21.15.16:0/3516960325 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa40b7f00 con 0x7ffaa40b6a10 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7ff689e00640 1 -- 172.21.15.16:0/878391871 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910477417 0 0) 0x7ff68c072c10 con 0x7ff68c0b7390 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7ff689e00640 1 -- 172.21.15.16:0/878391871 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff670003520 con 0x7ff68c0b7390 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7ff689e00640 1 -- 172.21.15.16:0/878391871 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606033369 0 0) 0x7ff68c072eb0 con 0x7ff68c073a30 2024-04-26T23:34:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7ff689e00640 1 -- 172.21.15.16:0/878391871 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68c072c10 con 0x7ff68c073a30 2024-04-26T23:34:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7facca000640 1 -- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7faccc0be6e0 msgr2=0x7faccc140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7facca000640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7faccc0be6e0 0x7faccc140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7facca000640 1 -- 172.21.15.16:0/1025616684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc1e1560 msgr2=0x7faccc1e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7facca000640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc1e1560 0x7faccc1e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7ff68b200640 1 -- 172.21.15.16:0/878391871 >> v1:172.21.15.32:6789/0 conn(0x7ff68c073a30 legacy=0x7ff68c146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7ff68b200640 1 -- 172.21.15.16:0/878391871 >> v1:172.21.15.16:6789/0 conn(0x7ff68c0b7390 legacy=0x7ff68c0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.174+0000 7ff68b200640 1 -- 172.21.15.16:0/878391871 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c0b6e60 con 0x7ff68c146d10 2024-04-26T23:34:55.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7facca000640 1 -- 172.21.15.16:0/1025616684 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faccc13e5c0 con 0x7faccc142170 2024-04-26T23:34:55.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7faccb400640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc1e1560 0x7faccc1e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:55.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7ffaa3e00640 1 --2- 172.21.15.16:0/3516960325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40b6a10 0x7ffaa4142020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40ba050 tx=0x7ffa9002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30a45ac2a9f478ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.175+0000 7f90f3200640 1 --2- 172.21.15.16:0/980246681 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f4142170 0x7f90f41425b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90f40b59d0 tx=0x7f90ec02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc93fb777c8a7ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7facca000640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faccc142170 0x7faccc1403d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7facbc031000 tx=0x7facbc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7ffaa3400640 1 -- 172.21.15.16:0/3516960325 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90037070 con 0x7ffaa40b6a10 2024-04-26T23:34:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7ffaa3400640 1 -- 172.21.15.16:0/3516960325 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa90032440 con 0x7ffaa40b6a10 2024-04-26T23:34:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7ffaa3400640 1 -- 172.21.15.16:0/3516960325 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90032810 con 0x7ffaa40b6a10 2024-04-26T23:34:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7ff68b200640 1 --2- 172.21.15.16:0/878391871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c146d10 0x7ff68c0b7770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff684009d90 tx=0x7ff68402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89622d21f37bca4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7f90f1400640 1 -- 172.21.15.16:0/980246681 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec036070 con 0x7f90f4142170 2024-04-26T23:34:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7f90f1400640 1 -- 172.21.15.16:0/980246681 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ec031600 con 0x7f90f4142170 2024-04-26T23:34:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7facc3400640 1 -- 172.21.15.16:0/1025616684 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc041030 con 0x7faccc142170 2024-04-26T23:34:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7facc3400640 1 -- 172.21.15.16:0/1025616684 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facbc03d4e0 con 0x7faccc142170 2024-04-26T23:34:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faccc1de710 con 0x7faccc142170 2024-04-26T23:34:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faccc1431a0 con 0x7faccc142170 2024-04-26T23:34:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ffaab600640 1 -- 172.21.15.16:0/3516960325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40b6a10 msgr2=0x7ffaa4142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ffaab600640 1 --2- 172.21.15.16:0/3516960325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40b6a10 0x7ffaa4142020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40ba050 tx=0x7ffa9002a1a0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ffaab600640 1 -- 172.21.15.16:0/3516960325 shutdown_connections 2024-04-26T23:34:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ffaab600640 1 --2- 172.21.15.16:0/3516960325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40b6a10 0x7ffaa4142020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ffaab600640 1 --2- 172.21.15.16:0/3516960325 >> v2:172.21.15.16:3300/0 conn(0x7ffaa40be7e0 0x7ffaa414ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ffaab600640 1 -- 172.21.15.16:0/3516960325 >> 172.21.15.16:0/3516960325 conn(0x7ffaa40686c0 msgr2=0x7ffaa40bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ff689e00640 1 -- 172.21.15.16:0/878391871 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684031600 con 0x7ff68c146d10 2024-04-26T23:34:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ff689e00640 1 -- 172.21.15.16:0/878391871 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6840317a0 con 0x7ff68c146d10 2024-04-26T23:34:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ff689e00640 1 -- 172.21.15.16:0/878391871 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684031b70 con 0x7ff68c146d10 2024-04-26T23:34:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.177+0000 7ffaab600640 1 -- 172.21.15.16:0/3516960325 shutdown_connections 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c146d10 msgr2=0x7ff68c0b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7ff690a00640 1 --2- 172.21.15.16:0/878391871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c146d10 0x7ff68c0b7770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff684009d90 tx=0x7ff68402a610 comp rx=0 tx=0).stop 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7ffaab600640 1 -- 172.21.15.16:0/3516960325 wait complete. 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.176+0000 7f90f1400640 1 -- 172.21.15.16:0/980246681 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0319d0 con 0x7f90f4142170 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 -- 172.21.15.16:0/980246681 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f4142170 msgr2=0x7f90f41425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 --2- 172.21.15.16:0/980246681 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f4142170 0x7f90f41425b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90f40b59d0 tx=0x7f90ec02a5f0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 -- 172.21.15.16:0/980246681 shutdown_connections 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 --2- 172.21.15.16:0/980246681 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f4142170 0x7f90f41425b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 --2- 172.21.15.16:0/980246681 >> v2:172.21.15.32:3300/0 conn(0x7f90f40ba3f0 0x7f90f414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 --2- 172.21.15.16:0/980246681 >> v2:172.21.15.16:3300/0 conn(0x7f90f40be6e0 0x7f90f414bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 -- 172.21.15.16:0/980246681 >> 172.21.15.16:0/980246681 conn(0x7f90f40686c0 msgr2=0x7f90f40bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 -- 172.21.15.16:0/980246681 shutdown_connections 2024-04-26T23:34:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.178+0000 7f90f9400640 1 -- 172.21.15.16:0/980246681 wait complete. 2024-04-26T23:34:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.179+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 shutdown_connections 2024-04-26T23:34:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.179+0000 7ff690a00640 1 --2- 172.21.15.16:0/878391871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c146d10 0x7ff68c0b7770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.179+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 >> 172.21.15.16:0/878391871 conn(0x7ff68c06c350 msgr2=0x7ff68c06c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.179+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faccc0b62f0 con 0x7faccc142170 2024-04-26T23:34:55.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.180+0000 7facc3400640 1 -- 172.21.15.16:0/1025616684 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc037040 con 0x7faccc142170 2024-04-26T23:34:55.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.180+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 shutdown_connections 2024-04-26T23:34:55.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.180+0000 7ffaab600640 1 Processor -- start 2024-04-26T23:34:55.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.180+0000 7ffaab600640 1 -- start start 2024-04-26T23:34:55.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.181+0000 7ffaab600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaa40b6a10 0x7ffaa41e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaab600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40be7e0 0x7ffaa41459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7f90f9400640 1 Processor -- start 2024-04-26T23:34:55.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaab600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ffaa4142560 0x7ffaa406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaab600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa40b5e50 con 0x7ffaa40b6a10 2024-04-26T23:34:55.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7f90f9400640 1 -- start start 2024-04-26T23:34:55.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaab600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa40b7c20 con 0x7ffaa40be7e0 2024-04-26T23:34:55.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaab600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa413fe70 con 0x7ffaa4142560 2024-04-26T23:34:55.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaa8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaa40b6a10 0x7ffaa41e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaa8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaa40b6a10 0x7ffaa41e1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35508/0 (socket says 172.21.15.16:35508) 2024-04-26T23:34:55.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ffaa8c00640 1 -- 172.21.15.16:0/3670230285 learned_addr learned my addr 172.21.15.16:0/3670230285 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7fa10ea00640 1 Processor -- start 2024-04-26T23:34:55.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.183+0000 7fa10ea00640 1 -- start start 2024-04-26T23:34:55.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.183+0000 7ffaa3e00640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40be7e0 0x7ffaa41459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7f90f9400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90f40be6e0 0x7f90f40bd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7f90f9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f4142170 0x7f90f41ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7f90f9400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f406f500 0x7f90f41ecbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.183+0000 7ffaa9600640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ffaa4142560 0x7ffaa406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7ffaa8c00640 1 -- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ffaa4142560 msgr2=0x7ffaa406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7ffaa8c00640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ffaa4142560 0x7ffaa406ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7ffaa8c00640 1 -- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40be7e0 msgr2=0x7ffaa41459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7ffaa8c00640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40be7e0 0x7ffaa41459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7ffaa8c00640 1 -- 172.21.15.16:0/3670230285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa4070770 con 0x7ffaa40b6a10 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.180+0000 7ff690a00640 1 -- 172.21.15.16:0/878391871 wait complete. 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.182+0000 7ff690a00640 1 Processor -- start 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7ff690a00640 1 -- start start 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7ff690a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff68c073a30 0x7ff68c0b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7ff690a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c0b7390 0x7ff68c148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7f90f9400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f90f40b5580 con 0x7f90f4142170 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7f90f1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f4142170 0x7f90f41ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7f90f9400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f90f40b5400 con 0x7f90f40be6e0 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7f90f9400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f90f40b6c00 con 0x7f90f406f500 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7f90f1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f4142170 0x7f90f41ec680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35510/0 (socket says 172.21.15.16:35510) 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7f90f1e00640 1 -- 172.21.15.16:0/2917095188 learned_addr learned my addr 172.21.15.16:0/2917095188 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7f90f2800640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90f40be6e0 0x7f90f40bd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7f90f3200640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f406f500 0x7f90f41ecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7f90f1e00640 1 -- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f406f500 msgr2=0x7f90f41ecbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7ffaa8c00640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaa40b6a10 0x7ffaa41e1f70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800e9b0 tx=0x7ffa9800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7ffaa0c00640 1 -- 172.21.15.16:0/3670230285 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98017070 con 0x7ffaa40b6a10 2024-04-26T23:34:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7ffaa0c00640 1 -- 172.21.15.16:0/3670230285 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9800c9a0 con 0x7ffaa40b6a10 2024-04-26T23:34:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7ffaa0c00640 1 -- 172.21.15.16:0/3670230285 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800cd90 con 0x7ffaa40b6a10 2024-04-26T23:34:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa4070490 con 0x7ffaa40b6a10 2024-04-26T23:34:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa40701b0 con 0x7ffaa40b6a10 2024-04-26T23:34:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7f378f200640 1 Processor -- start 2024-04-26T23:34:55.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7f378f200640 1 -- start start 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.184+0000 7fa10ea00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa1080b7150 0x7fa108149190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7fa107400640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa1080b03e0 0x7fa1080afad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:50586/0 (socket says 172.21.15.16:50586) 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7fa107e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa1080b1760 0x7fa10806e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32920/0 (socket says 172.21.15.16:32920) 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.185+0000 7fa107400640 1 -- 172.21.15.16:0/176672283 learned_addr learned my addr 172.21.15.16:0/176672283 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1080b12d0 con 0x7fa1080b1760 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1080b5950 con 0x7fa1080b03e0 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fa1080b01e0 con 0x7fa1080b7150 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.186+0000 7fa10ca00640 1 --2- 172.21.15.16:0/176672283 >> v2:172.21.15.32:3300/0 conn(0x7fa1080b7150 0x7fa108149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7ff690a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c146d10 0x7ff68c0b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024424963 0 0) 0x7fa1080b5950 con 0x7fa1080b03e0 2024-04-26T23:34:55.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0ec003520 con 0x7fa1080b03e0 2024-04-26T23:34:55.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7ff690a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c1580c0 con 0x7ff68c0b7390 2024-04-26T23:34:55.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7f90f1e00640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f406f500 0x7f90f41ecbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7f90f1e00640 1 -- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90f40be6e0 msgr2=0x7f90f40bd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7f90f1e00640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90f40be6e0 0x7f90f40bd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7f90f1e00640 1 -- 172.21.15.16:0/2917095188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f406f9a0 con 0x7f90f4142170 2024-04-26T23:34:55.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.187+0000 7f90f2800640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90f40be6e0 0x7f90f40bd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:55.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7ff68a800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff68c073a30 0x7ff68c0b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7ff68a800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff68c073a30 0x7ff68c0b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:56926/0 (socket says 172.21.15.16:56926) 2024-04-26T23:34:55.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317718327 0 0) 0x7fa1080b12d0 con 0x7fa1080b1760 2024-04-26T23:34:55.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1080b5950 con 0x7fa1080b1760 2024-04-26T23:34:55.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7f90f1e00640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f4142170 0x7f90f41ec680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90e000d800 tx=0x7f90e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7f378f200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f37900bba50 0x7f379009c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7facc3400640 1 -- 172.21.15.16:0/1025616684 <== mon.1 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facbc044070 con 0x7faccc142170 2024-04-26T23:34:55.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7fa10ca00640 1 -- 172.21.15.16:0/176672283 >> v1:172.21.15.32:6789/0 conn(0x7fa1080b03e0 legacy=0x7fa1080afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 <== mon.1 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3254604873 0 0) 0x7fa0ec003520 con 0x7fa1080b03e0 2024-04-26T23:34:55.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa4069ab0 con 0x7ffaa40b6a10 2024-04-26T23:34:55.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7f378f200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3790142c10 con 0x7f37900bcc10 2024-04-26T23:34:55.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7f378f200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379014bb80 con 0x7f379014c660 2024-04-26T23:34:55.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7f378f200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f379014be60 con 0x7f37900bba50 2024-04-26T23:34:55.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7fa10ca00640 1 -- 172.21.15.16:0/176672283 >> v1:172.21.15.16:6789/0 conn(0x7fa1080b1760 legacy=0x7fa10806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7fa10ca00640 1 -- 172.21.15.16:0/176672283 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1080b5c30 con 0x7fa1080b7150 2024-04-26T23:34:55.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7f378e800640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f379014c660 0x7f3790152d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:50588/0 (socket says 172.21.15.16:50588) 2024-04-26T23:34:55.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7f378e800640 1 -- 172.21.15.16:0/1109744574 learned_addr learned my addr 172.21.15.16:0/1109744574 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:55.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.190+0000 7facc3400640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7faca806c9c0 0x7faca806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.189+0000 7f90eaa00640 1 -- 172.21.15.16:0/2917095188 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e000b6c0 con 0x7f90f4142170 2024-04-26T23:34:55.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.190+0000 7facc3400640 1 -- 172.21.15.16:0/1025616684 <== mon.1 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7facbc0abff0 con 0x7faccc142170 2024-04-26T23:34:55.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7faccaa00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7faca806c9c0 0x7faca806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7f378d400640 1 --2- 172.21.15.16:0/1109744574 >> v2:172.21.15.32:3300/0 conn(0x7f37900bba50 0x7f379009c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.190+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f41ebba0 con 0x7f90f4142170 2024-04-26T23:34:55.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f4069ab0 con 0x7f90f4142170 2024-04-26T23:34:55.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7f90eaa00640 1 -- 172.21.15.16:0/2917095188 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e0019070 con 0x7f90f4142170 2024-04-26T23:34:55.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7f90eaa00640 1 -- 172.21.15.16:0/2917095188 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e000b6c0 con 0x7f90f4142170 2024-04-26T23:34:55.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7f378d400640 1 -- 172.21.15.16:0/1109744574 >> v1:172.21.15.32:6789/0 conn(0x7f379014c660 legacy=0x7f3790152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7ff690a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c073220 con 0x7ff68c146d10 2024-04-26T23:34:55.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.188+0000 7ff690a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7ff68c158240 con 0x7ff68c073a30 2024-04-26T23:34:55.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7ff68a800640 1 -- 172.21.15.16:0/1884597022 learned_addr learned my addr 172.21.15.16:0/1884597022 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.192+0000 7ff68b200640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c146d10 0x7ff68c0b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.193+0000 7fa10ca00640 1 --2- 172.21.15.16:0/176672283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b7150 0x7fa108149190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009720 tx=0x7fa0f802a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2697db1edd069d33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.193+0000 7ff681e00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c0b7390 0x7ff68c148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7f378d400640 1 -- 172.21.15.16:0/1109744574 >> v1:172.21.15.16:6789/0 conn(0x7f37900bcc10 legacy=0x7f37900bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.191+0000 7f378d400640 1 -- 172.21.15.16:0/1109744574 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379009c7d0 con 0x7f37900bba50 2024-04-26T23:34:55.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.194+0000 7ffaa0c00640 1 -- 172.21.15.16:0/3670230285 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa9801a070 con 0x7ffaa40b6a10 2024-04-26T23:34:55.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.194+0000 7faccaa00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7faca806c9c0 0x7faca806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facb4009b20 tx=0x7facb4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.194+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc005290 con 0x7f90f4142170 2024-04-26T23:34:55.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.195+0000 7ff68a800640 1 -- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c146d10 msgr2=0x7ff68c0b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.195+0000 7ff68a800640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c146d10 0x7ff68c0b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.195+0000 7ffaa0c00640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ffa8406c940 0x7ffa8406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.195+0000 7ff68a800640 1 -- 172.21.15.16:0/1884597022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c0b7390 msgr2=0x7ff68c148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.195+0000 7ff68a800640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c0b7390 0x7ff68c148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.195+0000 7ff68a800640 1 -- 172.21.15.16:0/1884597022 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c147dc0 con 0x7ff68c073a30 2024-04-26T23:34:55.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.196+0000 7f378d400640 1 --2- 172.21.15.16:0/1109744574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f379009c290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f377c0097a0 tx=0x7f377c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faed465af39abad4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.195+0000 7f90eaa00640 1 -- 172.21.15.16:0/2917095188 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90e000b860 con 0x7f90f4142170 2024-04-26T23:34:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.196+0000 7ffaa0c00640 1 -- 172.21.15.16:0/3670230285 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa98058160 con 0x7ffaa40b6a10 2024-04-26T23:34:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.196+0000 7ffaa3e00640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ffa8406c940 0x7ffa8406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.196+0000 7ff68a800640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff68c073a30 0x7ff68c0b2d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c530 tx=0x7ff67400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7f90eaa00640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d406caf0 0x7f90d406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7ff683400640 1 -- 172.21.15.16:0/1884597022 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674017070 con 0x7ff68c073a30 2024-04-26T23:34:55.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7ff683400640 1 -- 172.21.15.16:0/1884597022 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff674005ce0 con 0x7ff68c073a30 2024-04-26T23:34:55.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7ffaa3e00640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ffa8406c940 0x7ffa8406ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa90034000 tx=0x7ffa9002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68c1480a0 con 0x7ff68c073a30 2024-04-26T23:34:55.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7f90f2800640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d406caf0 0x7f90d406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68c0b4c80 con 0x7ff68c073a30 2024-04-26T23:34:55.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.197+0000 7ff683400640 1 -- 172.21.15.16:0/1884597022 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6740072b0 con 0x7ff68c073a30 2024-04-26T23:34:55.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.199+0000 7f90f2800640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d406caf0 0x7f90d406efb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009b10 tx=0x7f90e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.199+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68c076600 con 0x7ff68c073a30 2024-04-26T23:34:55.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.201+0000 7f90eaa00640 1 -- 172.21.15.16:0/2917095188 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f90e0057980 con 0x7f90f4142170 2024-04-26T23:34:55.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.202+0000 7ff683400640 1 -- 172.21.15.16:0/1884597022 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff67401a070 con 0x7ff68c073a30 2024-04-26T23:34:55.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.202+0000 7ffaa0c00640 1 -- 172.21.15.16:0/3670230285 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffaa4070770 con 0x7ffaa40b6a10 2024-04-26T23:34:55.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.203+0000 7ff683400640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff66806c8f0 0x7ff66806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.203+0000 7ff683400640 1 -- 172.21.15.16:0/1884597022 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff67408af00 con 0x7ff68c073a30 2024-04-26T23:34:55.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.204+0000 7ff681e00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff66806c8f0 0x7ff66806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.205+0000 7ff681e00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff66806c8f0 0x7ff66806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff68c1e6600 tx=0x7ff67c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.206+0000 7f90eaa00640 1 -- 172.21.15.16:0/2917095188 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f90e0059fe0 con 0x7f90f4142170 2024-04-26T23:34:55.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.208+0000 7f378ca00640 1 -- 172.21.15.16:0/1109744574 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c037070 con 0x7f37900bba50 2024-04-26T23:34:55.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.208+0000 7f378ca00640 1 -- 172.21.15.16:0/1109744574 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c032440 con 0x7f37900bba50 2024-04-26T23:34:55.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.208+0000 7f378ca00640 1 -- 172.21.15.16:0/1109744574 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c032810 con 0x7f37900bba50 2024-04-26T23:34:55.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.208+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 <== mon.1 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8037070 con 0x7fa1080b7150 2024-04-26T23:34:55.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7facc3400640 1 -- 172.21.15.16:0/1025616684 <== mon.1 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faccc0b62f0 con 0x7faccc142170 2024-04-26T23:34:55.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 <== mon.1 v2:172.21.15.32:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f802abe0 con 0x7fa1080b7150 2024-04-26T23:34:55.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7fa106a00640 1 -- 172.21.15.16:0/176672283 <== mon.1 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1000019f0 con 0x7fa1080b7150 2024-04-26T23:34:55.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7f378f200640 1 -- 172.21.15.16:0/1109744574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 msgr2=0x7f379009c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7f378f200640 1 --2- 172.21.15.16:0/1109744574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f379009c290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f377c0097a0 tx=0x7f377c02a230 comp rx=0 tx=0).stop 2024-04-26T23:34:55.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7f378f200640 1 -- 172.21.15.16:0/1109744574 shutdown_connections 2024-04-26T23:34:55.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7f378f200640 1 --2- 172.21.15.16:0/1109744574 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f379009c290 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.209+0000 7f378f200640 1 -- 172.21.15.16:0/1109744574 >> 172.21.15.16:0/1109744574 conn(0x7f3790068820 msgr2=0x7f379009f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.210+0000 7f378f200640 1 -- 172.21.15.16:0/1109744574 shutdown_connections 2024-04-26T23:34:55.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.210+0000 7f378f200640 1 -- 172.21.15.16:0/1109744574 wait complete. 2024-04-26T23:34:55.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.210+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b7150 msgr2=0x7fa108149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.210+0000 7fa10ea00640 1 --2- 172.21.15.16:0/176672283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b7150 0x7fa108149190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009720 tx=0x7fa0f802a0d0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.210+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 shutdown_connections 2024-04-26T23:34:55.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.210+0000 7fa10ea00640 1 --2- 172.21.15.16:0/176672283 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b7150 0x7fa108149190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.210+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 >> 172.21.15.16:0/176672283 conn(0x7fa1080b6630 msgr2=0x7fa1080b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.211+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 shutdown_connections 2024-04-26T23:34:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.211+0000 7fa10ea00640 1 -- 172.21.15.16:0/176672283 wait complete. 2024-04-26T23:34:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.212+0000 7f378f200640 1 Processor -- start 2024-04-26T23:34:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.212+0000 7f378f200640 1 -- start start 2024-04-26T23:34:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.213+0000 7fa10ea00640 1 Processor -- start 2024-04-26T23:34:55.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.213+0000 7fa10ea00640 1 -- start start 2024-04-26T23:34:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.214+0000 7f378f200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f37900b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.214+0000 7f378f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37900bcc10 0x7f37900ba100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.214+0000 7f378f200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f379014c660 0x7f37900b8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.214+0000 7f378f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f379009bba0 con 0x7f37900bcc10 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.214+0000 7f378f200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f379009ba20 con 0x7f37900bba50 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.214+0000 7f378f200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f379009bd20 con 0x7f379014c660 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.214+0000 7f378d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37900bcc10 0x7f37900ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37900bcc10 0x7f37900ba100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35530/0 (socket says 172.21.15.16:35530) 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378d400640 1 -- 172.21.15.16:0/1317337957 learned_addr learned my addr 172.21.15.16:0/1317337957 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378de00640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f37900b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378e800640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f379014c660 0x7f37900b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b03e0 0x7fa108140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378d400640 1 -- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f379014c660 msgr2=0x7f37900b8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378d400640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f379014c660 0x7f37900b8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378d400640 1 -- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 msgr2=0x7f37900b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378d400640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f37900b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.215+0000 7f378d400640 1 -- 172.21.15.16:0/1317337957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37901d18a0 con 0x7f37900bcc10 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa1080b1760 0x7fa108071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1080b7150 0x7fa1081393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa10ea00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa1081496d0 con 0x7fa1080b7150 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa10ea00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fa1080b0890 con 0x7fa1080b03e0 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa107e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b03e0 0x7fa108140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa107e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b03e0 0x7fa108140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.16:54540/0 (socket says 172.21.15.16:54540) 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa107e00640 1 -- 172.21.15.16:0/1113898034 learned_addr learned my addr 172.21.15.16:0/1113898034 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa107400640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa1080b1760 0x7fa108071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa10ea00640 1 -- 172.21.15.16:0/1113898034 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fa108149850 con 0x7fa1080b1760 2024-04-26T23:34:55.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.216+0000 7fa10ca00640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1080b7150 0x7fa1081393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.217+0000 7f378de00640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f37900b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:55.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.217+0000 7f378e800640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f379014c660 0x7f37900b8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:55.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.217+0000 7f378d400640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37900bcc10 0x7f37900ba100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f377c02a820 tx=0x7f377c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.217+0000 7fa107400640 1 -- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b03e0 msgr2=0x7fa108140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.217+0000 7fa107400640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b03e0 0x7fa108140000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.217+0000 7fa107400640 1 -- 172.21.15.16:0/1113898034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1080b7150 msgr2=0x7fa1081393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7fa107400640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1080b7150 0x7fa1081393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7fa107400640 1 -- 172.21.15.16:0/1113898034 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa108070810 con 0x7fa1080b1760 2024-04-26T23:34:55.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7f3786000640 1 -- 172.21.15.16:0/1317337957 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c040020 con 0x7f37900bcc10 2024-04-26T23:34:55.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7fa107e00640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b03e0 0x7fa108140000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:55.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7f3786000640 1 -- 172.21.15.16:0/1317337957 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c038040 con 0x7f37900bcc10 2024-04-26T23:34:55.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37900ba640 con 0x7f37900bcc10 2024-04-26T23:34:55.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7f3786000640 1 -- 172.21.15.16:0/1317337957 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c037070 con 0x7f37900bcc10 2024-04-26T23:34:55.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37900b8c70 con 0x7f37900bcc10 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.218+0000 7fa10ca00640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1080b7150 0x7fa1081393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.219+0000 7fa107400640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa1080b1760 0x7fa108071aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1080b1b60 tx=0x7fa10000ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.220+0000 7fa0ffe00640 1 -- 172.21.15.16:0/1113898034 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100018070 con 0x7fa1080b1760 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.220+0000 7fa0ffe00640 1 -- 172.21.15.16:0/1113898034 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10000a640 con 0x7fa1080b1760 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.220+0000 7fa0ffe00640 1 -- 172.21.15.16:0/1113898034 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10000aa30 con 0x7fa1080b1760 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.221+0000 7fa10ea00640 1 -- 172.21.15.16:0/1113898034 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1080730d0 con 0x7fa1080b1760 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.221+0000 7fa10ea00640 1 -- 172.21.15.16:0/1113898034 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa108072df0 con 0x7fa1080b1760 2024-04-26T23:34:55.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.222+0000 7ff683400640 1 -- 172.21.15.16:0/1884597022 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff674058d90 con 0x7ff68c073a30 2024-04-26T23:34:55.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.223+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37900a2b00 con 0x7f37900bcc10 2024-04-26T23:34:55.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.223+0000 7f3786000640 1 -- 172.21.15.16:0/1317337957 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f377c043020 con 0x7f37900bcc10 2024-04-26T23:34:55.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.225+0000 7f3786000640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f377006c9c0 0x7f377006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.225+0000 7f3786000640 1 -- 172.21.15.16:0/1317337957 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f377c0abff0 con 0x7f37900bcc10 2024-04-26T23:34:55.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.223+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc005290 con 0x7fa1080b1760 2024-04-26T23:34:55.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.225+0000 7fa0ffe00640 1 -- 172.21.15.16:0/1113898034 <== mon.2 v2:172.21.15.32:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa10001b070 con 0x7fa1080b1760 2024-04-26T23:34:55.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.226+0000 7f378de00640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f377006c9c0 0x7f377006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.227+0000 7fa0ffe00640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa0e806c9c0 0x7fa0e806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.227+0000 7fa0ffe00640 1 -- 172.21.15.16:0/1113898034 <== mon.2 v2:172.21.15.32:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa10008b1e0 con 0x7fa1080b1760 2024-04-26T23:34:55.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.227+0000 7f378de00640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f377006c9c0 0x7f377006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37900b4d80 tx=0x7f3788009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.228+0000 7fa107e00640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa0e806c9c0 0x7fa0e806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.229+0000 7fa107e00640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa0e806c9c0 0x7fa0e806ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40011e0 tx=0x7fa0f4007d90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.236+0000 7f3786000640 1 -- 172.21.15.16:0/1317337957 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f377c04a030 con 0x7f37900bcc10 2024-04-26T23:34:55.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.240+0000 7fa0ffe00640 1 -- 172.21.15.16:0/1113898034 <== mon.2 v2:172.21.15.32:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa100059030 con 0x7fa1080b1760 2024-04-26T23:34:55.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.549+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f775003c0a0 con 0x7f7750036a00 2024-04-26T23:34:55.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.550+0000 7f774b400640 1 -- 172.21.15.16:0/2993745961 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f774400e280 con 0x7f7750036a00 2024-04-26T23:34:55.554 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.554+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f773806c9c0 msgr2=0x7f773806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.554+0000 7f775d000640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f773806c9c0 0x7f773806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77500dccc0 tx=0x7f774c008040 comp rx=0 tx=0).stop 2024-04-26T23:34:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.554+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7750036a00 msgr2=0x7f77500edd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.554+0000 7f775d000640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7750036a00 0x7f77500edd70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f774400c3e0 tx=0x7f774400c8a0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.555+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 shutdown_connections 2024-04-26T23:34:55.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.555+0000 7f775d000640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f773806c9c0 0x7f773806ee80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.555+0000 7f775d000640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77500f2b20 0x7f77500e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.555+0000 7f775d000640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f77500377f0 0x7f77500e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.555+0000 7f775d000640 1 --2- 172.21.15.16:0/2993745961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7750036a00 0x7f77500edd70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.555+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 >> 172.21.15.16:0/2993745961 conn(0x7f775003a8a0 msgr2=0x7f77500e2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.556+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 shutdown_connections 2024-04-26T23:34:55.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.556+0000 7f775d000640 1 -- 172.21.15.16:0/2993745961 wait complete. 2024-04-26T23:34:55.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-04-26T23:34:55.586 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.600+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7aa0076600 con 0x7f7aa01d9680 2024-04-26T23:34:55.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.601+0000 7f7a96a00640 1 -- 172.21.15.16:0/315039372 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a90079f70 con 0x7f7aa01d9680 2024-04-26T23:34:55.604 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:55.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.604+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7a7c06c9c0 msgr2=0x7f7a7c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.604+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7a7c06c9c0 0x7f7a7c06ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a88001050 tx=0x7f7a88009040 comp rx=0 tx=0).stop 2024-04-26T23:34:55.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.604+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7aa01d9680 msgr2=0x7f7aa01d9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.604+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7aa01d9680 0x7f7aa01d9ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a9002af50 tx=0x7f7a900014a0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 shutdown_connections 2024-04-26T23:34:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7a7c06c9c0 0x7f7a7c06ee80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7aa0149e90 0x7f7aa014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7aa01d9680 0x7f7aa01d9ac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 --2- 172.21.15.16:0/315039372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a84004800 0x7f7aa0141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 >> 172.21.15.16:0/315039372 conn(0x7f7aa00bdc90 msgr2=0x7f7aa0142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 shutdown_connections 2024-04-26T23:34:55.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.605+0000 7f7a9fe00640 1 -- 172.21.15.16:0/315039372 wait complete. 2024-04-26T23:34:55.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-04-26T23:34:55.633 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.631+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3790069620 con 0x7f37900bcc10 2024-04-26T23:34:55.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.631+0000 7f3786000640 1 -- 172.21.15.16:0/1317337957 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f377c07a490 con 0x7f37900bcc10 2024-04-26T23:34:55.634 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.633+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f377006c9c0 msgr2=0x7f377006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.633+0000 7f378f200640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f377006c9c0 0x7f377006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37900b4d80 tx=0x7f3788009040 comp rx=0 tx=0).stop 2024-04-26T23:34:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.633+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37900bcc10 msgr2=0x7f37900ba100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.633+0000 7f378f200640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37900bcc10 0x7f37900ba100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f377c02a820 tx=0x7f377c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 shutdown_connections 2024-04-26T23:34:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f377006c9c0 0x7f377006ee80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f379014c660 0x7f37900b8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37900bcc10 0x7f37900ba100 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f377c02a820 tx=0x7f377c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 --2- 172.21.15.16:0/1317337957 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37900bba50 0x7f37900b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 >> 172.21.15.16:0/1317337957 conn(0x7f3790068820 msgr2=0x7f37901484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 shutdown_connections 2024-04-26T23:34:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.634+0000 7f378f200640 1 -- 172.21.15.16:0/1317337957 wait complete. 2024-04-26T23:34:55.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-04-26T23:34:55.653 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.653+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa0dc005580 con 0x7fa1080b1760 2024-04-26T23:34:55.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.654+0000 7fa0ffe00640 1 -- 172.21.15.16:0/1113898034 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa10005d330 con 0x7fa1080b1760 2024-04-26T23:34:55.657 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa0e806c9c0 msgr2=0x7fa0e806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa0e806c9c0 0x7fa0e806ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40011e0 tx=0x7fa0f4007d90 comp rx=0 tx=0).stop 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa1080b1760 msgr2=0x7fa108071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa1080b1760 0x7fa108071aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1080b1b60 tx=0x7fa10000ce10 comp rx=0 tx=0).stop 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 shutdown_connections 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa0e806c9c0 0x7fa0e806ee80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1080b7150 0x7fa1081393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa1080b1760 0x7fa108071aa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 --2- 172.21.15.16:0/1113898034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa1080b03e0 0x7fa108140000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.656+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 >> 172.21.15.16:0/1113898034 conn(0x7fa1080b6630 msgr2=0x7fa10806a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.657+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 shutdown_connections 2024-04-26T23:34:55.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.657+0000 7fa0fd600640 1 -- 172.21.15.16:0/1113898034 wait complete. 2024-04-26T23:34:55.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.659+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f90cc005580 con 0x7f90f4142170 2024-04-26T23:34:55.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.659+0000 7f90eaa00640 1 -- 172.21.15.16:0/2917095188 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f90e005ee20 con 0x7f90f4142170 2024-04-26T23:34:55.663 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-04-26T23:34:55.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d406caf0 msgr2=0x7f90d406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d406caf0 0x7f90d406efb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009b10 tx=0x7f90e4008040 comp rx=0 tx=0).stop 2024-04-26T23:34:55.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f4142170 msgr2=0x7f90f41ec680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f4142170 0x7f90f41ec680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90e000d800 tx=0x7f90e000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 shutdown_connections 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f90d406caf0 0x7f90d406efb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f90f406f500 0x7f90f41ecbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f4142170 0x7f90f41ec680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 --2- 172.21.15.16:0/2917095188 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90f40be6e0 0x7f90f40bd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 >> 172.21.15.16:0/2917095188 conn(0x7f90f40686c0 msgr2=0x7f90f40baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 shutdown_connections 2024-04-26T23:34:55.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.663+0000 7f90f9400640 1 -- 172.21.15.16:0/2917095188 wait complete. 2024-04-26T23:34:55.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.668+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ffaa4145310 con 0x7ffaa40b6a10 2024-04-26T23:34:55.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.668+0000 7ffaa0c00640 1 -- 172.21.15.16:0/3670230285 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa9805a7c0 con 0x7ffaa40b6a10 2024-04-26T23:34:55.672 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:55.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ffa8406c940 msgr2=0x7ffa8406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ffa8406c940 0x7ffa8406ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa90034000 tx=0x7ffa9002e000 comp rx=0 tx=0).stop 2024-04-26T23:34:55.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaa40b6a10 msgr2=0x7ffaa41e1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaa40b6a10 0x7ffaa41e1f70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800e9b0 tx=0x7ffa9800ee70 comp rx=0 tx=0).stop 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 shutdown_connections 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ffa8406c940 0x7ffa8406ee00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffaa40be7e0 0x7ffaa41459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ffaa4142560 0x7ffaa406ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 --2- 172.21.15.16:0/3670230285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaa40b6a10 0x7ffaa41e1f70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 >> 172.21.15.16:0/3670230285 conn(0x7ffaa40686c0 msgr2=0x7ffaa406a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 shutdown_connections 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.671+0000 7ffaab600640 1 -- 172.21.15.16:0/3670230285 wait complete. 2024-04-26T23:34:55.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.672+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faccc0693a0 con 0x7faccc142170 2024-04-26T23:34:55.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.673+0000 7facc3400640 1 -- 172.21.15.16:0/1025616684 <== mon.1 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7facbc079e40 con 0x7faccc142170 2024-04-26T23:34:55.676 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:55.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-04-26T23:34:55.677 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7faca806c9c0 msgr2=0x7faca806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7faca806c9c0 0x7faca806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facb4009b20 tx=0x7facb4009190 comp rx=0 tx=0).stop 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faccc142170 msgr2=0x7faccc1403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faccc142170 0x7faccc1403d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7facbc031000 tx=0x7facbc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 shutdown_connections 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7faca806c9c0 0x7faca806ee80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faccc142170 0x7faccc1403d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faccc1e1560 0x7faccc1e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 --2- 172.21.15.16:0/1025616684 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7faccc0be6e0 0x7faccc140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.676+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 >> 172.21.15.16:0/1025616684 conn(0x7faccc0686c0 msgr2=0x7faccc0b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.677+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 shutdown_connections 2024-04-26T23:34:55.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.677+0000 7facd1e00640 1 -- 172.21.15.16:0/1025616684 wait complete. 2024-04-26T23:34:55.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.679+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff68c144b00 con 0x7ff68c073a30 2024-04-26T23:34:55.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.679+0000 7ff683400640 1 -- 172.21.15.16:0/1884597022 <== mon.2 v2:172.21.15.32:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff67405d090 con 0x7ff68c073a30 2024-04-26T23:34:55.683 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T23:34:55.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff66806c8f0 msgr2=0x7ff66806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff66806c8f0 0x7ff66806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff68c1e6600 tx=0x7ff67c009040 comp rx=0 tx=0).stop 2024-04-26T23:34:55.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff68c073a30 msgr2=0x7ff68c0b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff68c073a30 0x7ff68c0b2d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c530 tx=0x7ff67400c9f0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 shutdown_connections 2024-04-26T23:34:55.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7ff66806c8f0 0x7ff66806edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff68c146d10 0x7ff68c0b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff68c0b7390 0x7ff68c148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 --2- 172.21.15.16:0/1884597022 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7ff68c073a30 0x7ff68c0b2d40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 >> 172.21.15.16:0/1884597022 conn(0x7ff68c06c350 msgr2=0x7ff68c0b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.682+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 shutdown_connections 2024-04-26T23:34:55.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.683+0000 7ff690a00640 1 -- 172.21.15.16:0/1884597022 wait complete. 2024-04-26T23:34:55.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-04-26T23:34:55.692 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-04-26T23:34:55.699 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-04-26T23:34:55.702 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-04-26T23:34:55.704 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:55.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:34:55.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:34:55.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.947+0000 7f89b2000640 1 Processor -- start 2024-04-26T23:34:55.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.948+0000 7f89b2000640 1 -- start start 2024-04-26T23:34:55.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.949+0000 7f89b2000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 0x7f89ac148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.949+0000 7f89b2000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac0bc010 con 0x7f89ac0bd7a0 2024-04-26T23:34:55.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.949+0000 7f89b2000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac148220 con 0x7f89ac0bbc30 2024-04-26T23:34:55.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.949+0000 7f89b2000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac149220 con 0x7f89ac073420 2024-04-26T23:34:55.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.949+0000 7f89abe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f89ac0bd7a0 0x7f89ac073cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32942/0 (socket says 172.21.15.16:32942) 2024-04-26T23:34:55.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.949+0000 7f89abe00640 1 -- 172.21.15.16:0/1377388042 learned_addr learned my addr 172.21.15.16:0/1377388042 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:55.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.949+0000 7f89b1600640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 0x7f89ac148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124132240 0 0) 0x7f89ac0bc010 con 0x7f89ac0bd7a0 2024-04-26T23:34:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8994003520 con 0x7f89ac0bd7a0 2024-04-26T23:34:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2072283745 0 0) 0x7f8994003520 con 0x7f89ac0bd7a0 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 msgr2=0x7f89ac148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 0x7f89ac148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 >> v1:172.21.15.32:6789/0 conn(0x7f89ac0bbc30 legacy=0x7f89ac0baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac1484e0 con 0x7f89ac0bd7a0 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f8998001670 con 0x7f89ac0bd7a0 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 >> v1:172.21.15.16:6789/0 conn(0x7f89ac0bd7a0 legacy=0x7f89ac073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 0x7f89940039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8994003f60 0x7f8994004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8994004d40 0x7f89940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac149220 con 0x7f8994004d40 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f899400bc00 con 0x7f8994003f60 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f899400be00 con 0x7f89ac073420 2024-04-26T23:34:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.950+0000 7f89b1600640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8994004d40 0x7f89940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89abe00640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8994003f60 0x7f8994004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89b0c00640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 0x7f89940039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89b1600640 1 -- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 msgr2=0x7f89940039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89b1600640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f89ac073420 0x7f89940039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89b1600640 1 -- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8994003f60 msgr2=0x7f8994004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89b1600640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8994003f60 0x7f8994004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89b1600640 1 -- 172.21.15.16:0/1377388042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8994003520 con 0x7f8994004d40 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.951+0000 7f89abe00640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8994003f60 0x7f8994004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.952+0000 7f89b1600640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8994004d40 0x7f89940051c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009fc0 tx=0x7f8994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5549eab37c0751 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.952+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4009c10 con 0x7f8994004d40 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.952+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a4036070 con 0x7f8994004d40 2024-04-26T23:34:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.952+0000 7f89ab400640 1 -- 172.21.15.16:0/1377388042 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4031860 con 0x7f8994004d40 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.952+0000 7f89b2000640 1 -- 172.21.15.16:0/1377388042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8994004d40 msgr2=0x7f89940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.952+0000 7f89b2000640 1 --2- 172.21.15.16:0/1377388042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8994004d40 0x7f89940051c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009fc0 tx=0x7f8994005830 comp rx=0 tx=0).stop 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.952+0000 7f89b1600640 1 -- 172.21.15.16:0/1377388042 reap_dead start 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.953+0000 7f89b2000640 1 -- 172.21.15.16:0/1377388042 shutdown_connections 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.953+0000 7f89b2000640 1 -- 172.21.15.16:0/1377388042 >> 172.21.15.16:0/1377388042 conn(0x7f89ac09fc60 msgr2=0x7f89ac0a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.953+0000 7f89b2000640 1 -- 172.21.15.16:0/1377388042 shutdown_connections 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.953+0000 7f89b2000640 1 -- 172.21.15.16:0/1377388042 wait complete. 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.954+0000 7f89b2000640 1 Processor -- start 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.954+0000 7f89b2000640 1 -- start start 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b2000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f8994004d40 0x7f89ac145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b2000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac142f20 0x7f89ac144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b2000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89ac1433a0 0x7f89ac140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b2000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac074580 con 0x7f89ac1433a0 2024-04-26T23:34:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b2000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac074400 con 0x7f89ac142f20 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b2000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac148ce0 con 0x7f8994004d40 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b1600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89ac1433a0 0x7f89ac140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b1600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89ac1433a0 0x7f89ac140f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35554/0 (socket says 172.21.15.16:35554) 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.955+0000 7f89b1600640 1 -- 172.21.15.16:0/4190465196 learned_addr learned my addr 172.21.15.16:0/4190465196 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89abe00640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac142f20 0x7f89ac144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b1600640 1 -- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f8994004d40 msgr2=0x7f89ac145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b0c00640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f8994004d40 0x7f89ac145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b1600640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f8994004d40 0x7f89ac145590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b1600640 1 -- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac142f20 msgr2=0x7f89ac144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b1600640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac142f20 0x7f89ac144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b1600640 1 -- 172.21.15.16:0/4190465196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac0b6960 con 0x7f89ac1433a0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b1600640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89ac1433a0 0x7f89ac140f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e230 tx=0x7f89a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89a8c00640 1 -- 172.21.15.16:0/4190465196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4009c10 con 0x7f89ac1433a0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89a8c00640 1 -- 172.21.15.16:0/4190465196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a4031bc0 con 0x7f89ac1433a0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac144b20 con 0x7f89ac1433a0 2024-04-26T23:34:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89a8c00640 1 -- 172.21.15.16:0/4190465196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4045430 con 0x7f89ac1433a0 2024-04-26T23:34:55.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.956+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac0b7800 con 0x7f89ac1433a0 2024-04-26T23:34:55.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.958+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac0b7a00 con 0x7f89ac1433a0 2024-04-26T23:34:55.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.959+0000 7f89a8c00640 1 -- 172.21.15.16:0/4190465196 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89a4005d10 con 0x7f89ac1433a0 2024-04-26T23:34:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.959+0000 7f89a8c00640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f898c06c920 0x7f898c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.959+0000 7f89a8c00640 1 -- 172.21.15.16:0/4190465196 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f89a40acb10 con 0x7f89ac1433a0 2024-04-26T23:34:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.960+0000 7f89b0c00640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f898c06c920 0x7f898c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:55.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.961+0000 7f89b0c00640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f898c06c920 0x7f898c06ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f89ac145d80 tx=0x7f89a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:55.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:55.964+0000 7f89a8c00640 1 -- 172.21.15.16:0/4190465196 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f89ac0b7a00 con 0x7f89ac1433a0 2024-04-26T23:34:56.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.158+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89ac076600 con 0x7f898c06c920 2024-04-26T23:34:56.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.177+0000 7f89a8c00640 1 -- 172.21.15.16:0/4190465196 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251832 (secure 0 0 0) 0x7f89ac076600 con 0x7f898c06c920 2024-04-26T23:34:56.185 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:56.186 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T23:34:56.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f898c06c920 msgr2=0x7f898c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f898c06c920 0x7f898c06ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f89ac145d80 tx=0x7f89a0009040 comp rx=0 tx=0).stop 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89ac1433a0 msgr2=0x7f89ac140f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89ac1433a0 0x7f89ac140f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f89a400e230 tx=0x7f89a4009750 comp rx=0 tx=0).stop 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 shutdown_connections 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f898c06c920 0x7f898c06ede0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac142f20 0x7f89ac144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89ac1433a0 0x7f89ac140f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 --2- 172.21.15.16:0/4190465196 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f8994004d40 0x7f89ac145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 >> 172.21.15.16:0/4190465196 conn(0x7f89ac09fc60 msgr2=0x7f89ac0b8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.183+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 shutdown_connections 2024-04-26T23:34:56.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.184+0000 7f89b2000640 1 -- 172.21.15.16:0/4190465196 wait complete. 2024-04-26T23:34:56.204 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T23:34:55.810020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252288,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722432,"statfs":{"total":773094113280,"available":772835770368,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.749584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105954+0000","last_change":"2024-04-26T23:34:46.097057+0000","last_active":"2024-04-26T23:34:47.105954+0000","last_peered":"2024-04-26T23:34:47.105954+0000","last_clean":"2024-04-26T23:34:47.105954+0000","last_became_active":"2024-04-26T23:34:46.096589+0000","last_became_peered":"2024-04-26T23:34:46.096589+0000","last_unstale":"2024-04-26T23:34:47.105954+0000","last_undegraded":"2024-04-26T23:34:47.105954+0000","last_fullsized":"2024-04-26T23:34:47.105954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198535+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-26T23:34:47.198535+0000","last_peered":"2024-04-26T23:34:47.198535+0000","last_clean":"2024-04-26T23:34:47.198535+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-26T23:34:47.198535+0000","last_undegraded":"2024-04-26T23:34:47.198535+0000","last_fullsized":"2024-04-26T23:34:47.198535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199433+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-26T23:34:47.199433+0000","last_peered":"2024-04-26T23:34:47.199433+0000","last_clean":"2024-04-26T23:34:47.199433+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-26T23:34:47.199433+0000","last_undegraded":"2024-04-26T23:34:47.199433+0000","last_fullsized":"2024-04-26T23:34:47.199433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193060+0000","last_change":"2024-04-26T23:34:46.102692+0000","last_active":"2024-04-26T23:34:47.193060+0000","last_peered":"2024-04-26T23:34:47.193060+0000","last_clean":"2024-04-26T23:34:47.193060+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-26T23:34:47.193060+0000","last_undegraded":"2024-04-26T23:34:47.193060+0000","last_fullsized":"2024-04-26T23:34:47.193060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105877+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-26T23:34:47.105877+0000","last_peered":"2024-04-26T23:34:47.105877+0000","last_clean":"2024-04-26T23:34:47.105877+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-26T23:34:47.105877+0000","last_undegraded":"2024-04-26T23:34:47.105877+0000","last_fullsized":"2024-04-26T23:34:47.105877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193373+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-26T23:34:47.193373+0000","last_peered":"2024-04-26T23:34:47.193373+0000","last_clean":"2024-04-26T23:34:47.193373+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-26T23:34:47.193373+0000","last_undegraded":"2024-04-26T23:34:47.193373+0000","last_fullsized":"2024-04-26T23:34:47.193373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105307+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-26T23:34:47.105307+0000","last_peered":"2024-04-26T23:34:47.105307+0000","last_clean":"2024-04-26T23:34:47.105307+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-26T23:34:47.105307+0000","last_undegraded":"2024-04-26T23:34:47.105307+0000","last_fullsized":"2024-04-26T23:34:47.105307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198176+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-26T23:34:47.198176+0000","last_peered":"2024-04-26T23:34:47.198176+0000","last_clean":"2024-04-26T23:34:47.198176+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-26T23:34:47.198176+0000","last_undegraded":"2024-04-26T23:34:47.198176+0000","last_fullsized":"2024-04-26T23:34:47.198176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194623+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-26T23:34:47.194623+0000","last_peered":"2024-04-26T23:34:47.194623+0000","last_clean":"2024-04-26T23:34:47.194623+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-26T23:34:47.194623+0000","last_undegraded":"2024-04-26T23:34:47.194623+0000","last_fullsized":"2024-04-26T23:34:47.194623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105626+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-26T23:34:47.105626+0000","last_peered":"2024-04-26T23:34:47.105626+0000","last_clean":"2024-04-26T23:34:47.105626+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-26T23:34:47.105626+0000","last_undegraded":"2024-04-26T23:34:47.105626+0000","last_fullsized":"2024-04-26T23:34:47.105626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105942+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-26T23:34:47.105942+0000","last_peered":"2024-04-26T23:34:47.105942+0000","last_clean":"2024-04-26T23:34:47.105942+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-26T23:34:47.105942+0000","last_undegraded":"2024-04-26T23:34:47.105942+0000","last_fullsized":"2024-04-26T23:34:47.105942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105579+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-26T23:34:47.105579+0000","last_peered":"2024-04-26T23:34:47.105579+0000","last_clean":"2024-04-26T23:34:47.105579+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-26T23:34:47.105579+0000","last_undegraded":"2024-04-26T23:34:47.105579+0000","last_fullsized":"2024-04-26T23:34:47.105579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196258+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-26T23:34:47.196258+0000","last_peered":"2024-04-26T23:34:47.196258+0000","last_clean":"2024-04-26T23:34:47.196258+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-26T23:34:47.196258+0000","last_undegraded":"2024-04-26T23:34:47.196258+0000","last_fullsized":"2024-04-26T23:34:47.196258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195637+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-26T23:34:47.195637+0000","last_peered":"2024-04-26T23:34:47.195637+0000","last_clean":"2024-04-26T23:34:47.195637+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-26T23:34:47.195637+0000","last_undegraded":"2024-04-26T23:34:47.195637+0000","last_fullsized":"2024-04-26T23:34:47.195637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.197849+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-26T23:34:47.197849+0000","last_peered":"2024-04-26T23:34:47.197849+0000","last_clean":"2024-04-26T23:34:47.197849+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-26T23:34:47.197849+0000","last_undegraded":"2024-04-26T23:34:47.197849+0000","last_fullsized":"2024-04-26T23:34:47.197849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072035+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-26T23:34:47.072035+0000","last_peered":"2024-04-26T23:34:47.072035+0000","last_clean":"2024-04-26T23:34:47.072035+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-26T23:34:47.072035+0000","last_undegraded":"2024-04-26T23:34:47.072035+0000","last_fullsized":"2024-04-26T23:34:47.072035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072812+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-26T23:34:47.072812+0000","last_peered":"2024-04-26T23:34:47.072812+0000","last_clean":"2024-04-26T23:34:47.072812+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-26T23:34:47.072812+0000","last_undegraded":"2024-04-26T23:34:47.072812+0000","last_fullsized":"2024-04-26T23:34:47.072812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:37.828024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077980+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-26T23:34:47.077980+0000","last_peered":"2024-04-26T23:34:47.077980+0000","last_clean":"2024-04-26T23:34:47.077980+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-26T23:34:47.077980+0000","last_undegraded":"2024-04-26T23:34:47.077980+0000","last_fullsized":"2024-04-26T23:34:47.077980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072768+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-26T23:34:47.072768+0000","last_peered":"2024-04-26T23:34:47.072768+0000","last_clean":"2024-04-26T23:34:47.072768+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-26T23:34:47.072768+0000","last_undegraded":"2024-04-26T23:34:47.072768+0000","last_fullsized":"2024-04-26T23:34:47.072768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:09.342327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105979+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-26T23:34:47.105979+0000","last_peered":"2024-04-26T23:34:47.105979+0000","last_clean":"2024-04-26T23:34:47.105979+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-26T23:34:47.105979+0000","last_undegraded":"2024-04-26T23:34:47.105979+0000","last_fullsized":"2024-04-26T23:34:47.105979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075980+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-26T23:34:47.075980+0000","last_peered":"2024-04-26T23:34:47.075980+0000","last_clean":"2024-04-26T23:34:47.075980+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-26T23:34:47.075980+0000","last_undegraded":"2024-04-26T23:34:47.075980+0000","last_fullsized":"2024-04-26T23:34:47.075980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192852+0000","last_change":"2024-04-26T23:34:46.096164+0000","last_active":"2024-04-26T23:34:47.192852+0000","last_peered":"2024-04-26T23:34:47.192852+0000","last_clean":"2024-04-26T23:34:47.192852+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-26T23:34:47.192852+0000","last_undegraded":"2024-04-26T23:34:47.192852+0000","last_fullsized":"2024-04-26T23:34:47.192852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198089+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-26T23:34:47.198089+0000","last_peered":"2024-04-26T23:34:47.198089+0000","last_clean":"2024-04-26T23:34:47.198089+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-26T23:34:47.198089+0000","last_undegraded":"2024-04-26T23:34:47.198089+0000","last_fullsized":"2024-04-26T23:34:47.198089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072155+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-26T23:34:47.072155+0000","last_peered":"2024-04-26T23:34:47.072155+0000","last_clean":"2024-04-26T23:34:47.072155+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-26T23:34:47.072155+0000","last_undegraded":"2024-04-26T23:34:47.072155+0000","last_fullsized":"2024-04-26T23:34:47.072155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199062+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-26T23:34:47.199062+0000","last_peered":"2024-04-26T23:34:47.199062+0000","last_clean":"2024-04-26T23:34:47.199062+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-26T23:34:47.199062+0000","last_undegraded":"2024-04-26T23:34:47.199062+0000","last_fullsized":"2024-04-26T23:34:47.199062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194860+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-26T23:34:47.194860+0000","last_peered":"2024-04-26T23:34:47.194860+0000","last_clean":"2024-04-26T23:34:47.194860+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-26T23:34:47.194860+0000","last_undegraded":"2024-04-26T23:34:47.194860+0000","last_fullsized":"2024-04-26T23:34:47.194860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196782+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-26T23:34:47.196782+0000","last_peered":"2024-04-26T23:34:47.196782+0000","last_clean":"2024-04-26T23:34:47.196782+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-26T23:34:47.196782+0000","last_undegraded":"2024-04-26T23:34:47.196782+0000","last_fullsized":"2024-04-26T23:34:47.196782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196512+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-26T23:34:47.196512+0000","last_peered":"2024-04-26T23:34:47.196512+0000","last_clean":"2024-04-26T23:34:47.196512+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-26T23:34:47.196512+0000","last_undegraded":"2024-04-26T23:34:47.196512+0000","last_fullsized":"2024-04-26T23:34:47.196512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198188+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-26T23:34:47.198188+0000","last_peered":"2024-04-26T23:34:47.198188+0000","last_clean":"2024-04-26T23:34:47.198188+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-26T23:34:47.198188+0000","last_undegraded":"2024-04-26T23:34:47.198188+0000","last_fullsized":"2024-04-26T23:34:47.198188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:54.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073240+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-26T23:34:47.073240+0000","last_peered":"2024-04-26T23:34:47.073240+0000","last_clean":"2024-04-26T23:34:47.073240+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-26T23:34:47.073240+0000","last_undegraded":"2024-04-26T23:34:47.073240+0000","last_fullsized":"2024-04-26T23:34:47.073240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:08.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075776+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-26T23:34:47.075776+0000","last_peered":"2024-04-26T23:34:47.075776+0000","last_clean":"2024-04-26T23:34:47.075776+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-26T23:34:47.075776+0000","last_undegraded":"2024-04-26T23:34:47.075776+0000","last_fullsized":"2024-04-26T23:34:47.075776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192796+0000","last_change":"2024-04-26T23:34:46.098997+0000","last_active":"2024-04-26T23:34:47.192796+0000","last_peered":"2024-04-26T23:34:47.192796+0000","last_clean":"2024-04-26T23:34:47.192796+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-26T23:34:47.192796+0000","last_undegraded":"2024-04-26T23:34:47.192796+0000","last_fullsized":"2024-04-26T23:34:47.192796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192954+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-26T23:34:47.192954+0000","last_peered":"2024-04-26T23:34:47.192954+0000","last_clean":"2024-04-26T23:34:47.192954+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-26T23:34:47.192954+0000","last_undegraded":"2024-04-26T23:34:47.192954+0000","last_fullsized":"2024-04-26T23:34:47.192954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198600+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-26T23:34:47.198600+0000","last_peered":"2024-04-26T23:34:47.198600+0000","last_clean":"2024-04-26T23:34:47.198600+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-26T23:34:47.198600+0000","last_undegraded":"2024-04-26T23:34:47.198600+0000","last_fullsized":"2024-04-26T23:34:47.198600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076668+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-26T23:34:47.076668+0000","last_peered":"2024-04-26T23:34:47.076668+0000","last_clean":"2024-04-26T23:34:47.076668+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-26T23:34:47.076668+0000","last_undegraded":"2024-04-26T23:34:47.076668+0000","last_fullsized":"2024-04-26T23:34:47.076668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073206+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-26T23:34:47.073206+0000","last_peered":"2024-04-26T23:34:47.073206+0000","last_clean":"2024-04-26T23:34:47.073206+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-26T23:34:47.073206+0000","last_undegraded":"2024-04-26T23:34:47.073206+0000","last_fullsized":"2024-04-26T23:34:47.073206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195482+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-26T23:34:47.195482+0000","last_peered":"2024-04-26T23:34:47.195482+0000","last_clean":"2024-04-26T23:34:47.195482+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-26T23:34:47.195482+0000","last_undegraded":"2024-04-26T23:34:47.195482+0000","last_fullsized":"2024-04-26T23:34:47.195482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198663+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-26T23:34:47.198663+0000","last_peered":"2024-04-26T23:34:47.198663+0000","last_clean":"2024-04-26T23:34:47.198663+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-26T23:34:47.198663+0000","last_undegraded":"2024-04-26T23:34:47.198663+0000","last_fullsized":"2024-04-26T23:34:47.198663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072344+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-26T23:34:47.072344+0000","last_peered":"2024-04-26T23:34:47.072344+0000","last_clean":"2024-04-26T23:34:47.072344+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-26T23:34:47.072344+0000","last_undegraded":"2024-04-26T23:34:47.072344+0000","last_fullsized":"2024-04-26T23:34:47.072344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076210+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-26T23:34:47.076210+0000","last_peered":"2024-04-26T23:34:47.076210+0000","last_clean":"2024-04-26T23:34:47.076210+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-26T23:34:47.076210+0000","last_undegraded":"2024-04-26T23:34:47.076210+0000","last_fullsized":"2024-04-26T23:34:47.076210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194726+0000","last_change":"2024-04-26T23:34:45.074623+0000","last_active":"2024-04-26T23:34:47.194726+0000","last_peered":"2024-04-26T23:34:47.194726+0000","last_clean":"2024-04-26T23:34:47.194726+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-26T23:34:47.194726+0000","last_undegraded":"2024-04-26T23:34:47.194726+0000","last_fullsized":"2024-04-26T23:34:47.194726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195194+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-26T23:34:47.195194+0000","last_peered":"2024-04-26T23:34:47.195194+0000","last_clean":"2024-04-26T23:34:47.195194+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-26T23:34:47.195194+0000","last_undegraded":"2024-04-26T23:34:47.195194+0000","last_fullsized":"2024-04-26T23:34:47.195194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105702+0000","last_change":"2024-04-26T23:34:45.073763+0000","last_active":"2024-04-26T23:34:47.105702+0000","last_peered":"2024-04-26T23:34:47.105702+0000","last_clean":"2024-04-26T23:34:47.105702+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-26T23:34:47.105702+0000","last_undegraded":"2024-04-26T23:34:47.105702+0000","last_fullsized":"2024-04-26T23:34:47.105702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:07.508274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199289+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-26T23:34:47.199289+0000","last_peered":"2024-04-26T23:34:47.199289+0000","last_clean":"2024-04-26T23:34:47.199289+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-26T23:34:47.199289+0000","last_undegraded":"2024-04-26T23:34:47.199289+0000","last_fullsized":"2024-04-26T23:34:47.199289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077282+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-26T23:34:47.077282+0000","last_peered":"2024-04-26T23:34:47.077282+0000","last_clean":"2024-04-26T23:34:47.077282+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-26T23:34:47.077282+0000","last_undegraded":"2024-04-26T23:34:47.077282+0000","last_fullsized":"2024-04-26T23:34:47.077282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073045+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-26T23:34:47.073045+0000","last_peered":"2024-04-26T23:34:47.073045+0000","last_clean":"2024-04-26T23:34:47.073045+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-26T23:34:47.073045+0000","last_undegraded":"2024-04-26T23:34:47.073045+0000","last_fullsized":"2024-04-26T23:34:47.073045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:03.761817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193193+0000","last_change":"2024-04-26T23:34:45.074276+0000","last_active":"2024-04-26T23:34:47.193193+0000","last_peered":"2024-04-26T23:34:47.193193+0000","last_clean":"2024-04-26T23:34:47.193193+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-26T23:34:47.193193+0000","last_undegraded":"2024-04-26T23:34:47.193193+0000","last_fullsized":"2024-04-26T23:34:47.193193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:33.430917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106164+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-26T23:34:47.106164+0000","last_peered":"2024-04-26T23:34:47.106164+0000","last_clean":"2024-04-26T23:34:47.106164+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-26T23:34:47.106164+0000","last_undegraded":"2024-04-26T23:34:47.106164+0000","last_fullsized":"2024-04-26T23:34:47.106164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077577+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-26T23:34:47.077577+0000","last_peered":"2024-04-26T23:34:47.077577+0000","last_clean":"2024-04-26T23:34:47.077577+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-26T23:34:47.077577+0000","last_undegraded":"2024-04-26T23:34:47.077577+0000","last_fullsized":"2024-04-26T23:34:47.077577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196880+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-26T23:34:47.196880+0000","last_peered":"2024-04-26T23:34:47.196880+0000","last_clean":"2024-04-26T23:34:47.196880+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-26T23:34:47.196880+0000","last_undegraded":"2024-04-26T23:34:47.196880+0000","last_fullsized":"2024-04-26T23:34:47.196880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073359+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-26T23:34:47.073359+0000","last_peered":"2024-04-26T23:34:47.073359+0000","last_clean":"2024-04-26T23:34:47.073359+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-26T23:34:47.073359+0000","last_undegraded":"2024-04-26T23:34:47.073359+0000","last_fullsized":"2024-04-26T23:34:47.073359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:49.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072955+0000","last_change":"2024-04-26T23:34:46.093800+0000","last_active":"2024-04-26T23:34:47.072955+0000","last_peered":"2024-04-26T23:34:47.072955+0000","last_clean":"2024-04-26T23:34:47.072955+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-26T23:34:47.072955+0000","last_undegraded":"2024-04-26T23:34:47.072955+0000","last_fullsized":"2024-04-26T23:34:47.072955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:07.701378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105379+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-26T23:34:47.105379+0000","last_peered":"2024-04-26T23:34:47.105379+0000","last_clean":"2024-04-26T23:34:47.105379+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-26T23:34:47.105379+0000","last_undegraded":"2024-04-26T23:34:47.105379+0000","last_fullsized":"2024-04-26T23:34:47.105379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195048+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-26T23:34:47.195048+0000","last_peered":"2024-04-26T23:34:47.195048+0000","last_clean":"2024-04-26T23:34:47.195048+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-26T23:34:47.195048+0000","last_undegraded":"2024-04-26T23:34:47.195048+0000","last_fullsized":"2024-04-26T23:34:47.195048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:08.523129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076152+0000","last_change":"2024-04-26T23:34:45.072379+0000","last_active":"2024-04-26T23:34:47.076152+0000","last_peered":"2024-04-26T23:34:47.076152+0000","last_clean":"2024-04-26T23:34:47.076152+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-26T23:34:47.076152+0000","last_undegraded":"2024-04-26T23:34:47.076152+0000","last_fullsized":"2024-04-26T23:34:47.076152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072186+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-26T23:34:47.072186+0000","last_peered":"2024-04-26T23:34:47.072186+0000","last_clean":"2024-04-26T23:34:47.072186+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-26T23:34:47.072186+0000","last_undegraded":"2024-04-26T23:34:47.072186+0000","last_fullsized":"2024-04-26T23:34:47.072186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106231+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-26T23:34:47.106231+0000","last_peered":"2024-04-26T23:34:47.106231+0000","last_clean":"2024-04-26T23:34:47.106231+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-26T23:34:47.106231+0000","last_undegraded":"2024-04-26T23:34:47.106231+0000","last_fullsized":"2024-04-26T23:34:47.106231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195501+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-26T23:34:47.195501+0000","last_peered":"2024-04-26T23:34:47.195501+0000","last_clean":"2024-04-26T23:34:47.195501+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-26T23:34:47.195501+0000","last_undegraded":"2024-04-26T23:34:47.195501+0000","last_fullsized":"2024-04-26T23:34:47.195501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076869+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-26T23:34:47.076869+0000","last_peered":"2024-04-26T23:34:47.076869+0000","last_clean":"2024-04-26T23:34:47.076869+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-26T23:34:47.076869+0000","last_undegraded":"2024-04-26T23:34:47.076869+0000","last_fullsized":"2024-04-26T23:34:47.076869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106140+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-26T23:34:47.106140+0000","last_peered":"2024-04-26T23:34:47.106140+0000","last_clean":"2024-04-26T23:34:47.106140+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-26T23:34:47.106140+0000","last_undegraded":"2024-04-26T23:34:47.106140+0000","last_fullsized":"2024-04-26T23:34:47.106140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198925+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-26T23:34:47.198925+0000","last_peered":"2024-04-26T23:34:47.198925+0000","last_clean":"2024-04-26T23:34:47.198925+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-26T23:34:47.198925+0000","last_undegraded":"2024-04-26T23:34:47.198925+0000","last_fullsized":"2024-04-26T23:34:47.198925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105774+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-26T23:34:47.105774+0000","last_peered":"2024-04-26T23:34:47.105774+0000","last_clean":"2024-04-26T23:34:47.105774+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-26T23:34:47.105774+0000","last_undegraded":"2024-04-26T23:34:47.105774+0000","last_fullsized":"2024-04-26T23:34:47.105774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196798+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-26T23:34:47.196798+0000","last_peered":"2024-04-26T23:34:47.196798+0000","last_clean":"2024-04-26T23:34:47.196798+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-26T23:34:47.196798+0000","last_undegraded":"2024-04-26T23:34:47.196798+0000","last_fullsized":"2024-04-26T23:34:47.196798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072553+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-26T23:34:47.072553+0000","last_peered":"2024-04-26T23:34:47.072553+0000","last_clean":"2024-04-26T23:34:47.072553+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-26T23:34:47.072553+0000","last_undegraded":"2024-04-26T23:34:47.072553+0000","last_fullsized":"2024-04-26T23:34:47.072553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:10.277157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192890+0000","last_change":"2024-04-26T23:34:41.212862+0000","last_active":"2024-04-26T23:34:47.192890+0000","last_peered":"2024-04-26T23:34:47.192890+0000","last_clean":"2024-04-26T23:34:47.192890+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-26T23:34:47.192890+0000","last_undegraded":"2024-04-26T23:34:47.192890+0000","last_fullsized":"2024-04-26T23:34:47.192890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_clean_scrub_stamp":"2024-04-26T23:34:39.876770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:44.232023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073259+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-26T23:34:47.073259+0000","last_peered":"2024-04-26T23:34:47.073259+0000","last_clean":"2024-04-26T23:34:47.073259+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-26T23:34:47.073259+0000","last_undegraded":"2024-04-26T23:34:47.073259+0000","last_fullsized":"2024-04-26T23:34:47.073259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:35.809938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076511+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-26T23:34:47.076511+0000","last_peered":"2024-04-26T23:34:47.076511+0000","last_clean":"2024-04-26T23:34:47.076511+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-26T23:34:47.076511+0000","last_undegraded":"2024-04-26T23:34:47.076511+0000","last_fullsized":"2024-04-26T23:34:47.076511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072426+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-26T23:34:47.072426+0000","last_peered":"2024-04-26T23:34:47.072426+0000","last_clean":"2024-04-26T23:34:47.072426+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-26T23:34:47.072426+0000","last_undegraded":"2024-04-26T23:34:47.072426+0000","last_fullsized":"2024-04-26T23:34:47.072426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195191+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-26T23:34:47.195191+0000","last_peered":"2024-04-26T23:34:47.195191+0000","last_clean":"2024-04-26T23:34:47.195191+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-26T23:34:47.195191+0000","last_undegraded":"2024-04-26T23:34:47.195191+0000","last_fullsized":"2024-04-26T23:34:47.195191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075729+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-26T23:34:47.075729+0000","last_peered":"2024-04-26T23:34:47.075729+0000","last_clean":"2024-04-26T23:34:47.075729+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-26T23:34:47.075729+0000","last_undegraded":"2024-04-26T23:34:47.075729+0000","last_fullsized":"2024-04-26T23:34:47.075729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198333+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-26T23:34:47.198333+0000","last_peered":"2024-04-26T23:34:47.198333+0000","last_clean":"2024-04-26T23:34:47.198333+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-26T23:34:47.198333+0000","last_undegraded":"2024-04-26T23:34:47.198333+0000","last_fullsized":"2024-04-26T23:34:47.198333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073439+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-26T23:34:47.073439+0000","last_peered":"2024-04-26T23:34:47.073439+0000","last_clean":"2024-04-26T23:34:47.073439+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-26T23:34:47.073439+0000","last_undegraded":"2024-04-26T23:34:47.073439+0000","last_fullsized":"2024-04-26T23:34:47.073439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:21.723421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105537+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-26T23:34:47.105537+0000","last_peered":"2024-04-26T23:34:47.105537+0000","last_clean":"2024-04-26T23:34:47.105537+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-26T23:34:47.105537+0000","last_undegraded":"2024-04-26T23:34:47.105537+0000","last_fullsized":"2024-04-26T23:34:47.105537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198599+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-26T23:34:47.198599+0000","last_peered":"2024-04-26T23:34:47.198599+0000","last_clean":"2024-04-26T23:34:47.198599+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-26T23:34:47.198599+0000","last_undegraded":"2024-04-26T23:34:47.198599+0000","last_fullsized":"2024-04-26T23:34:47.198599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193652+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-26T23:34:47.193652+0000","last_peered":"2024-04-26T23:34:47.193652+0000","last_clean":"2024-04-26T23:34:47.193652+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-26T23:34:47.193652+0000","last_undegraded":"2024-04-26T23:34:47.193652+0000","last_fullsized":"2024-04-26T23:34:47.193652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072874+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-26T23:34:47.072874+0000","last_peered":"2024-04-26T23:34:47.072874+0000","last_clean":"2024-04-26T23:34:47.072874+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-26T23:34:47.072874+0000","last_undegraded":"2024-04-26T23:34:47.072874+0000","last_fullsized":"2024-04-26T23:34:47.072874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:33.819205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196711+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-26T23:34:47.196711+0000","last_peered":"2024-04-26T23:34:47.196711+0000","last_clean":"2024-04-26T23:34:47.196711+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-26T23:34:47.196711+0000","last_undegraded":"2024-04-26T23:34:47.196711+0000","last_fullsized":"2024-04-26T23:34:47.196711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.103576+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-26T23:34:47.103576+0000","last_peered":"2024-04-26T23:34:47.103576+0000","last_clean":"2024-04-26T23:34:47.103576+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-26T23:34:47.103576+0000","last_undegraded":"2024-04-26T23:34:47.103576+0000","last_fullsized":"2024-04-26T23:34:47.103576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077018+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-26T23:34:47.077018+0000","last_peered":"2024-04-26T23:34:47.077018+0000","last_clean":"2024-04-26T23:34:47.077018+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-26T23:34:47.077018+0000","last_undegraded":"2024-04-26T23:34:47.077018+0000","last_fullsized":"2024-04-26T23:34:47.077018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072779+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-26T23:34:47.072779+0000","last_peered":"2024-04-26T23:34:47.072779+0000","last_clean":"2024-04-26T23:34:47.072779+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-26T23:34:47.072779+0000","last_undegraded":"2024-04-26T23:34:47.072779+0000","last_fullsized":"2024-04-26T23:34:47.072779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:19.687355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076579+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-26T23:34:47.076579+0000","last_peered":"2024-04-26T23:34:47.076579+0000","last_clean":"2024-04-26T23:34:47.076579+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-26T23:34:47.076579+0000","last_undegraded":"2024-04-26T23:34:47.076579+0000","last_fullsized":"2024-04-26T23:34:47.076579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105602+0000","last_change":"2024-04-26T23:34:45.076058+0000","last_active":"2024-04-26T23:34:47.105602+0000","last_peered":"2024-04-26T23:34:47.105602+0000","last_clean":"2024-04-26T23:34:47.105602+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-26T23:34:47.105602+0000","last_undegraded":"2024-04-26T23:34:47.105602+0000","last_fullsized":"2024-04-26T23:34:47.105602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072971+0000","last_change":"2024-04-26T23:34:46.092601+0000","last_active":"2024-04-26T23:34:47.072971+0000","last_peered":"2024-04-26T23:34:47.072971+0000","last_clean":"2024-04-26T23:34:47.072971+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-26T23:34:47.072971+0000","last_undegraded":"2024-04-26T23:34:47.072971+0000","last_fullsized":"2024-04-26T23:34:47.072971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:01.319097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076569+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-26T23:34:47.076569+0000","last_peered":"2024-04-26T23:34:47.076569+0000","last_clean":"2024-04-26T23:34:47.076569+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-26T23:34:47.076569+0000","last_undegraded":"2024-04-26T23:34:47.076569+0000","last_fullsized":"2024-04-26T23:34:47.076569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077738+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-26T23:34:47.077738+0000","last_peered":"2024-04-26T23:34:47.077738+0000","last_clean":"2024-04-26T23:34:47.077738+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-26T23:34:47.077738+0000","last_undegraded":"2024-04-26T23:34:47.077738+0000","last_fullsized":"2024-04-26T23:34:47.077738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196010+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-26T23:34:47.196010+0000","last_peered":"2024-04-26T23:34:47.196010+0000","last_clean":"2024-04-26T23:34:47.196010+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-26T23:34:47.196010+0000","last_undegraded":"2024-04-26T23:34:47.196010+0000","last_fullsized":"2024-04-26T23:34:47.196010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077281+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-26T23:34:47.077281+0000","last_peered":"2024-04-26T23:34:47.077281+0000","last_clean":"2024-04-26T23:34:47.077281+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-26T23:34:47.077281+0000","last_undegraded":"2024-04-26T23:34:47.077281+0000","last_fullsized":"2024-04-26T23:34:47.077281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073024+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-26T23:34:47.073024+0000","last_peered":"2024-04-26T23:34:47.073024+0000","last_clean":"2024-04-26T23:34:47.073024+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-26T23:34:47.073024+0000","last_undegraded":"2024-04-26T23:34:47.073024+0000","last_fullsized":"2024-04-26T23:34:47.073024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:35.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072912+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-26T23:34:47.072912+0000","last_peered":"2024-04-26T23:34:47.072912+0000","last_clean":"2024-04-26T23:34:47.072912+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-26T23:34:47.072912+0000","last_undegraded":"2024-04-26T23:34:47.072912+0000","last_fullsized":"2024-04-26T23:34:47.072912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:37.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072327+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-26T23:34:47.072327+0000","last_peered":"2024-04-26T23:34:47.072327+0000","last_clean":"2024-04-26T23:34:47.072327+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-26T23:34:47.072327+0000","last_undegraded":"2024-04-26T23:34:47.072327+0000","last_fullsized":"2024-04-26T23:34:47.072327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105857+0000","last_change":"2024-04-26T23:34:45.075234+0000","last_active":"2024-04-26T23:34:47.105857+0000","last_peered":"2024-04-26T23:34:47.105857+0000","last_clean":"2024-04-26T23:34:47.105857+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-26T23:34:47.105857+0000","last_undegraded":"2024-04-26T23:34:47.105857+0000","last_fullsized":"2024-04-26T23:34:47.105857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194840+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-26T23:34:47.194840+0000","last_peered":"2024-04-26T23:34:47.194840+0000","last_clean":"2024-04-26T23:34:47.194840+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-26T23:34:47.194840+0000","last_undegraded":"2024-04-26T23:34:47.194840+0000","last_fullsized":"2024-04-26T23:34:47.194840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106263+0000","last_change":"2024-04-26T23:34:45.074596+0000","last_active":"2024-04-26T23:34:47.106263+0000","last_peered":"2024-04-26T23:34:47.106263+0000","last_clean":"2024-04-26T23:34:47.106263+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-26T23:34:47.106263+0000","last_undegraded":"2024-04-26T23:34:47.106263+0000","last_fullsized":"2024-04-26T23:34:47.106263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199369+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-26T23:34:47.199369+0000","last_peered":"2024-04-26T23:34:47.199369+0000","last_clean":"2024-04-26T23:34:47.199369+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-26T23:34:47.199369+0000","last_undegraded":"2024-04-26T23:34:47.199369+0000","last_fullsized":"2024-04-26T23:34:47.199369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199395+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-26T23:34:47.199395+0000","last_peered":"2024-04-26T23:34:47.199395+0000","last_clean":"2024-04-26T23:34:47.199395+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-26T23:34:47.199395+0000","last_undegraded":"2024-04-26T23:34:47.199395+0000","last_fullsized":"2024-04-26T23:34:47.199395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199201+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-26T23:34:47.199201+0000","last_peered":"2024-04-26T23:34:47.199201+0000","last_clean":"2024-04-26T23:34:47.199201+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-26T23:34:47.199201+0000","last_undegraded":"2024-04-26T23:34:47.199201+0000","last_fullsized":"2024-04-26T23:34:47.199201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077353+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-26T23:34:47.077353+0000","last_peered":"2024-04-26T23:34:47.077353+0000","last_clean":"2024-04-26T23:34:47.077353+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-26T23:34:47.077353+0000","last_undegraded":"2024-04-26T23:34:47.077353+0000","last_fullsized":"2024-04-26T23:34:47.077353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":70990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:34:56.207 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:34:56.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.452+0000 7f3910c00640 1 Processor -- start 2024-04-26T23:34:56.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.453+0000 7f3910c00640 1 -- start start 2024-04-26T23:34:56.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.454+0000 7f3910c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f390c0bbc30 0x7f390c148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.454+0000 7f3910c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f390c073420 0x7f390c073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.454+0000 7f3910c00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390c0bc010 con 0x7f390c0bd7a0 2024-04-26T23:34:56.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.454+0000 7f3910c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f390c149220 con 0x7f390c073420 2024-04-26T23:34:56.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.454+0000 7f3910c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f390c148220 con 0x7f390c0bbc30 2024-04-26T23:34:56.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f390c073420 0x7f390c073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f390c073420 0x7f390c073cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35558/0 (socket says 172.21.15.16:35558) 2024-04-26T23:34:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390be00640 1 -- 172.21.15.16:0/3137437164 learned_addr learned my addr 172.21.15.16:0/3137437164 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390b400640 1 --2- 172.21.15.16:0/3137437164 >> v2:172.21.15.32:3300/0 conn(0x7f390c0bbc30 0x7f390c148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390be00640 1 -- 172.21.15.16:0/3137437164 >> v2:172.21.15.32:3300/0 conn(0x7f390c0bbc30 msgr2=0x7f390c148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390be00640 1 --2- 172.21.15.16:0/3137437164 >> v2:172.21.15.32:3300/0 conn(0x7f390c0bbc30 0x7f390c148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390be00640 1 -- 172.21.15.16:0/3137437164 >> v1:172.21.15.32:6789/0 conn(0x7f390c0bd7a0 legacy=0x7f390c0baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.455+0000 7f390be00640 1 -- 172.21.15.16:0/3137437164 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c1484e0 con 0x7f390c073420 2024-04-26T23:34:56.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.457+0000 7f390be00640 1 --2- 172.21.15.16:0/3137437164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c073cf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f390c09bc40 tx=0x7f390402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b0e2a0471a0f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:56.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.457+0000 7f390a000640 1 -- 172.21.15.16:0/3137437164 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904037070 con 0x7f390c073420 2024-04-26T23:34:56.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.457+0000 7f390a000640 1 -- 172.21.15.16:0/3137437164 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390402ae10 con 0x7f390c073420 2024-04-26T23:34:56.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.457+0000 7f390a000640 1 -- 172.21.15.16:0/3137437164 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904032660 con 0x7f390c073420 2024-04-26T23:34:56.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 -- 172.21.15.16:0/3137437164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 msgr2=0x7f390c073cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 --2- 172.21.15.16:0/3137437164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c073cf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f390c09bc40 tx=0x7f390402a100 comp rx=0 tx=0).stop 2024-04-26T23:34:56.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 -- 172.21.15.16:0/3137437164 shutdown_connections 2024-04-26T23:34:56.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 --2- 172.21.15.16:0/3137437164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c073cf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 --2- 172.21.15.16:0/3137437164 >> v2:172.21.15.32:3300/0 conn(0x7f390c0bbc30 0x7f390c148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 -- 172.21.15.16:0/3137437164 >> 172.21.15.16:0/3137437164 conn(0x7f390c09fc60 msgr2=0x7f390c0a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:56.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 -- 172.21.15.16:0/3137437164 shutdown_connections 2024-04-26T23:34:56.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.458+0000 7f3910c00640 1 -- 172.21.15.16:0/3137437164 wait complete. 2024-04-26T23:34:56.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.460+0000 7f3910c00640 1 Processor -- start 2024-04-26T23:34:56.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.460+0000 7f3910c00640 1 -- start start 2024-04-26T23:34:56.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.461+0000 7f3910c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.461+0000 7f3910c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f390c0bbc30 0x7f390c1ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.461+0000 7f3910c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f390c0bd7a0 0x7f390c1de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.461+0000 7f3910c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0743b0 con 0x7f390c073420 2024-04-26T23:34:56.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.461+0000 7f3910c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f390c074230 con 0x7f390c0bd7a0 2024-04-26T23:34:56.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.461+0000 7f3910c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f390c074530 con 0x7f390c0bbc30 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35566/0 (socket says 172.21.15.16:35566) 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 -- 172.21.15.16:0/2201909585 learned_addr learned my addr 172.21.15.16:0/2201909585 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 -- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f390c0bbc30 msgr2=0x7f390c1ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f390c0bbc30 0x7f390c1ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 -- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f390c0bd7a0 msgr2=0x7f390c1de2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390be00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f390c0bd7a0 0x7f390c1de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f390c0bd7a0 0x7f390c1de2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 -- 172.21.15.16:0/2201909585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c14b0a0 con 0x7f390c073420 2024-04-26T23:34:56.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.462+0000 7f390b400640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c0b3da0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38f400d800 tx=0x7f38f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:56.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.463+0000 7f3903400640 1 -- 172.21.15.16:0/2201909585 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f400b6c0 con 0x7f390c073420 2024-04-26T23:34:56.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.463+0000 7f3903400640 1 -- 172.21.15.16:0/2201909585 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f4019070 con 0x7f390c073420 2024-04-26T23:34:56.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.463+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c143c40 con 0x7f390c073420 2024-04-26T23:34:56.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.463+0000 7f3903400640 1 -- 172.21.15.16:0/2201909585 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f400ba80 con 0x7f390c073420 2024-04-26T23:34:56.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.463+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c14adc0 con 0x7f390c073420 2024-04-26T23:34:56.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.464+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c076600 con 0x7f390c073420 2024-04-26T23:34:56.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.465+0000 7f3903400640 1 -- 172.21.15.16:0/2201909585 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38f400bc20 con 0x7f390c073420 2024-04-26T23:34:56.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.466+0000 7f3903400640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f38e806c8f0 0x7f38e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.466+0000 7f3903400640 1 -- 172.21.15.16:0/2201909585 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38f408bfe0 con 0x7f390c073420 2024-04-26T23:34:56.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.466+0000 7f390aa00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f38e806c8f0 0x7f38e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.468+0000 7f390aa00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f38e806c8f0 0x7f38e806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f390c0b9820 tx=0x7f38fc009230 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:56.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.470+0000 7f3903400640 1 -- 172.21.15.16:0/2201909585 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f38f405a420 con 0x7f390c073420 2024-04-26T23:34:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.664+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f390c147480 con 0x7f38e806c8f0 2024-04-26T23:34:56.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.683+0000 7f3903400640 1 -- 172.21.15.16:0/2201909585 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251832 (secure 0 0 0) 0x7f390c147480 con 0x7f38e806c8f0 2024-04-26T23:34:56.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:56.691 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T23:34:56.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f38e806c8f0 msgr2=0x7f38e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f38e806c8f0 0x7f38e806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f390c0b9820 tx=0x7f38fc009230 comp rx=0 tx=0).stop 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 msgr2=0x7f390c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c0b3da0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38f400d800 tx=0x7f38f400dcc0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 shutdown_connections 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f38e806c8f0 0x7f38e806edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f390c0bd7a0 0x7f390c1de2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f390c0bbc30 0x7f390c1ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 --2- 172.21.15.16:0/2201909585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c073420 0x7f390c0b3da0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.688+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 >> 172.21.15.16:0/2201909585 conn(0x7f390c09fc60 msgr2=0x7f390c09bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.689+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 shutdown_connections 2024-04-26T23:34:56.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.689+0000 7f3910c00640 1 -- 172.21.15.16:0/2201909585 wait complete. 2024-04-26T23:34:56.710 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T23:34:55.810020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252288,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722432,"statfs":{"total":773094113280,"available":772835770368,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.749584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105954+0000","last_change":"2024-04-26T23:34:46.097057+0000","last_active":"2024-04-26T23:34:47.105954+0000","last_peered":"2024-04-26T23:34:47.105954+0000","last_clean":"2024-04-26T23:34:47.105954+0000","last_became_active":"2024-04-26T23:34:46.096589+0000","last_became_peered":"2024-04-26T23:34:46.096589+0000","last_unstale":"2024-04-26T23:34:47.105954+0000","last_undegraded":"2024-04-26T23:34:47.105954+0000","last_fullsized":"2024-04-26T23:34:47.105954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198535+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-26T23:34:47.198535+0000","last_peered":"2024-04-26T23:34:47.198535+0000","last_clean":"2024-04-26T23:34:47.198535+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-26T23:34:47.198535+0000","last_undegraded":"2024-04-26T23:34:47.198535+0000","last_fullsized":"2024-04-26T23:34:47.198535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199433+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-26T23:34:47.199433+0000","last_peered":"2024-04-26T23:34:47.199433+0000","last_clean":"2024-04-26T23:34:47.199433+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-26T23:34:47.199433+0000","last_undegraded":"2024-04-26T23:34:47.199433+0000","last_fullsized":"2024-04-26T23:34:47.199433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193060+0000","last_change":"2024-04-26T23:34:46.102692+0000","last_active":"2024-04-26T23:34:47.193060+0000","last_peered":"2024-04-26T23:34:47.193060+0000","last_clean":"2024-04-26T23:34:47.193060+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-26T23:34:47.193060+0000","last_undegraded":"2024-04-26T23:34:47.193060+0000","last_fullsized":"2024-04-26T23:34:47.193060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105877+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-26T23:34:47.105877+0000","last_peered":"2024-04-26T23:34:47.105877+0000","last_clean":"2024-04-26T23:34:47.105877+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-26T23:34:47.105877+0000","last_undegraded":"2024-04-26T23:34:47.105877+0000","last_fullsized":"2024-04-26T23:34:47.105877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193373+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-26T23:34:47.193373+0000","last_peered":"2024-04-26T23:34:47.193373+0000","last_clean":"2024-04-26T23:34:47.193373+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-26T23:34:47.193373+0000","last_undegraded":"2024-04-26T23:34:47.193373+0000","last_fullsized":"2024-04-26T23:34:47.193373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105307+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-26T23:34:47.105307+0000","last_peered":"2024-04-26T23:34:47.105307+0000","last_clean":"2024-04-26T23:34:47.105307+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-26T23:34:47.105307+0000","last_undegraded":"2024-04-26T23:34:47.105307+0000","last_fullsized":"2024-04-26T23:34:47.105307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198176+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-26T23:34:47.198176+0000","last_peered":"2024-04-26T23:34:47.198176+0000","last_clean":"2024-04-26T23:34:47.198176+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-26T23:34:47.198176+0000","last_undegraded":"2024-04-26T23:34:47.198176+0000","last_fullsized":"2024-04-26T23:34:47.198176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194623+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-26T23:34:47.194623+0000","last_peered":"2024-04-26T23:34:47.194623+0000","last_clean":"2024-04-26T23:34:47.194623+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-26T23:34:47.194623+0000","last_undegraded":"2024-04-26T23:34:47.194623+0000","last_fullsized":"2024-04-26T23:34:47.194623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105626+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-26T23:34:47.105626+0000","last_peered":"2024-04-26T23:34:47.105626+0000","last_clean":"2024-04-26T23:34:47.105626+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-26T23:34:47.105626+0000","last_undegraded":"2024-04-26T23:34:47.105626+0000","last_fullsized":"2024-04-26T23:34:47.105626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105942+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-26T23:34:47.105942+0000","last_peered":"2024-04-26T23:34:47.105942+0000","last_clean":"2024-04-26T23:34:47.105942+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-26T23:34:47.105942+0000","last_undegraded":"2024-04-26T23:34:47.105942+0000","last_fullsized":"2024-04-26T23:34:47.105942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105579+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-26T23:34:47.105579+0000","last_peered":"2024-04-26T23:34:47.105579+0000","last_clean":"2024-04-26T23:34:47.105579+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-26T23:34:47.105579+0000","last_undegraded":"2024-04-26T23:34:47.105579+0000","last_fullsized":"2024-04-26T23:34:47.105579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196258+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-26T23:34:47.196258+0000","last_peered":"2024-04-26T23:34:47.196258+0000","last_clean":"2024-04-26T23:34:47.196258+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-26T23:34:47.196258+0000","last_undegraded":"2024-04-26T23:34:47.196258+0000","last_fullsized":"2024-04-26T23:34:47.196258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195637+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-26T23:34:47.195637+0000","last_peered":"2024-04-26T23:34:47.195637+0000","last_clean":"2024-04-26T23:34:47.195637+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-26T23:34:47.195637+0000","last_undegraded":"2024-04-26T23:34:47.195637+0000","last_fullsized":"2024-04-26T23:34:47.195637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.197849+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-26T23:34:47.197849+0000","last_peered":"2024-04-26T23:34:47.197849+0000","last_clean":"2024-04-26T23:34:47.197849+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-26T23:34:47.197849+0000","last_undegraded":"2024-04-26T23:34:47.197849+0000","last_fullsized":"2024-04-26T23:34:47.197849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072035+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-26T23:34:47.072035+0000","last_peered":"2024-04-26T23:34:47.072035+0000","last_clean":"2024-04-26T23:34:47.072035+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-26T23:34:47.072035+0000","last_undegraded":"2024-04-26T23:34:47.072035+0000","last_fullsized":"2024-04-26T23:34:47.072035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072812+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-26T23:34:47.072812+0000","last_peered":"2024-04-26T23:34:47.072812+0000","last_clean":"2024-04-26T23:34:47.072812+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-26T23:34:47.072812+0000","last_undegraded":"2024-04-26T23:34:47.072812+0000","last_fullsized":"2024-04-26T23:34:47.072812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:37.828024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077980+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-26T23:34:47.077980+0000","last_peered":"2024-04-26T23:34:47.077980+0000","last_clean":"2024-04-26T23:34:47.077980+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-26T23:34:47.077980+0000","last_undegraded":"2024-04-26T23:34:47.077980+0000","last_fullsized":"2024-04-26T23:34:47.077980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072768+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-26T23:34:47.072768+0000","last_peered":"2024-04-26T23:34:47.072768+0000","last_clean":"2024-04-26T23:34:47.072768+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-26T23:34:47.072768+0000","last_undegraded":"2024-04-26T23:34:47.072768+0000","last_fullsized":"2024-04-26T23:34:47.072768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:09.342327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105979+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-26T23:34:47.105979+0000","last_peered":"2024-04-26T23:34:47.105979+0000","last_clean":"2024-04-26T23:34:47.105979+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-26T23:34:47.105979+0000","last_undegraded":"2024-04-26T23:34:47.105979+0000","last_fullsized":"2024-04-26T23:34:47.105979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075980+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-26T23:34:47.075980+0000","last_peered":"2024-04-26T23:34:47.075980+0000","last_clean":"2024-04-26T23:34:47.075980+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-26T23:34:47.075980+0000","last_undegraded":"2024-04-26T23:34:47.075980+0000","last_fullsized":"2024-04-26T23:34:47.075980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192852+0000","last_change":"2024-04-26T23:34:46.096164+0000","last_active":"2024-04-26T23:34:47.192852+0000","last_peered":"2024-04-26T23:34:47.192852+0000","last_clean":"2024-04-26T23:34:47.192852+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-26T23:34:47.192852+0000","last_undegraded":"2024-04-26T23:34:47.192852+0000","last_fullsized":"2024-04-26T23:34:47.192852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198089+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-26T23:34:47.198089+0000","last_peered":"2024-04-26T23:34:47.198089+0000","last_clean":"2024-04-26T23:34:47.198089+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-26T23:34:47.198089+0000","last_undegraded":"2024-04-26T23:34:47.198089+0000","last_fullsized":"2024-04-26T23:34:47.198089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072155+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-26T23:34:47.072155+0000","last_peered":"2024-04-26T23:34:47.072155+0000","last_clean":"2024-04-26T23:34:47.072155+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-26T23:34:47.072155+0000","last_undegraded":"2024-04-26T23:34:47.072155+0000","last_fullsized":"2024-04-26T23:34:47.072155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199062+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-26T23:34:47.199062+0000","last_peered":"2024-04-26T23:34:47.199062+0000","last_clean":"2024-04-26T23:34:47.199062+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-26T23:34:47.199062+0000","last_undegraded":"2024-04-26T23:34:47.199062+0000","last_fullsized":"2024-04-26T23:34:47.199062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194860+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-26T23:34:47.194860+0000","last_peered":"2024-04-26T23:34:47.194860+0000","last_clean":"2024-04-26T23:34:47.194860+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-26T23:34:47.194860+0000","last_undegraded":"2024-04-26T23:34:47.194860+0000","last_fullsized":"2024-04-26T23:34:47.194860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196782+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-26T23:34:47.196782+0000","last_peered":"2024-04-26T23:34:47.196782+0000","last_clean":"2024-04-26T23:34:47.196782+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-26T23:34:47.196782+0000","last_undegraded":"2024-04-26T23:34:47.196782+0000","last_fullsized":"2024-04-26T23:34:47.196782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196512+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-26T23:34:47.196512+0000","last_peered":"2024-04-26T23:34:47.196512+0000","last_clean":"2024-04-26T23:34:47.196512+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-26T23:34:47.196512+0000","last_undegraded":"2024-04-26T23:34:47.196512+0000","last_fullsized":"2024-04-26T23:34:47.196512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198188+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-26T23:34:47.198188+0000","last_peered":"2024-04-26T23:34:47.198188+0000","last_clean":"2024-04-26T23:34:47.198188+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-26T23:34:47.198188+0000","last_undegraded":"2024-04-26T23:34:47.198188+0000","last_fullsized":"2024-04-26T23:34:47.198188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:54.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073240+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-26T23:34:47.073240+0000","last_peered":"2024-04-26T23:34:47.073240+0000","last_clean":"2024-04-26T23:34:47.073240+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-26T23:34:47.073240+0000","last_undegraded":"2024-04-26T23:34:47.073240+0000","last_fullsized":"2024-04-26T23:34:47.073240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:08.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075776+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-26T23:34:47.075776+0000","last_peered":"2024-04-26T23:34:47.075776+0000","last_clean":"2024-04-26T23:34:47.075776+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-26T23:34:47.075776+0000","last_undegraded":"2024-04-26T23:34:47.075776+0000","last_fullsized":"2024-04-26T23:34:47.075776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192796+0000","last_change":"2024-04-26T23:34:46.098997+0000","last_active":"2024-04-26T23:34:47.192796+0000","last_peered":"2024-04-26T23:34:47.192796+0000","last_clean":"2024-04-26T23:34:47.192796+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-26T23:34:47.192796+0000","last_undegraded":"2024-04-26T23:34:47.192796+0000","last_fullsized":"2024-04-26T23:34:47.192796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192954+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-26T23:34:47.192954+0000","last_peered":"2024-04-26T23:34:47.192954+0000","last_clean":"2024-04-26T23:34:47.192954+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-26T23:34:47.192954+0000","last_undegraded":"2024-04-26T23:34:47.192954+0000","last_fullsized":"2024-04-26T23:34:47.192954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198600+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-26T23:34:47.198600+0000","last_peered":"2024-04-26T23:34:47.198600+0000","last_clean":"2024-04-26T23:34:47.198600+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-26T23:34:47.198600+0000","last_undegraded":"2024-04-26T23:34:47.198600+0000","last_fullsized":"2024-04-26T23:34:47.198600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076668+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-26T23:34:47.076668+0000","last_peered":"2024-04-26T23:34:47.076668+0000","last_clean":"2024-04-26T23:34:47.076668+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-26T23:34:47.076668+0000","last_undegraded":"2024-04-26T23:34:47.076668+0000","last_fullsized":"2024-04-26T23:34:47.076668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073206+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-26T23:34:47.073206+0000","last_peered":"2024-04-26T23:34:47.073206+0000","last_clean":"2024-04-26T23:34:47.073206+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-26T23:34:47.073206+0000","last_undegraded":"2024-04-26T23:34:47.073206+0000","last_fullsized":"2024-04-26T23:34:47.073206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195482+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-26T23:34:47.195482+0000","last_peered":"2024-04-26T23:34:47.195482+0000","last_clean":"2024-04-26T23:34:47.195482+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-26T23:34:47.195482+0000","last_undegraded":"2024-04-26T23:34:47.195482+0000","last_fullsized":"2024-04-26T23:34:47.195482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198663+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-26T23:34:47.198663+0000","last_peered":"2024-04-26T23:34:47.198663+0000","last_clean":"2024-04-26T23:34:47.198663+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-26T23:34:47.198663+0000","last_undegraded":"2024-04-26T23:34:47.198663+0000","last_fullsized":"2024-04-26T23:34:47.198663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072344+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-26T23:34:47.072344+0000","last_peered":"2024-04-26T23:34:47.072344+0000","last_clean":"2024-04-26T23:34:47.072344+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-26T23:34:47.072344+0000","last_undegraded":"2024-04-26T23:34:47.072344+0000","last_fullsized":"2024-04-26T23:34:47.072344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076210+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-26T23:34:47.076210+0000","last_peered":"2024-04-26T23:34:47.076210+0000","last_clean":"2024-04-26T23:34:47.076210+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-26T23:34:47.076210+0000","last_undegraded":"2024-04-26T23:34:47.076210+0000","last_fullsized":"2024-04-26T23:34:47.076210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194726+0000","last_change":"2024-04-26T23:34:45.074623+0000","last_active":"2024-04-26T23:34:47.194726+0000","last_peered":"2024-04-26T23:34:47.194726+0000","last_clean":"2024-04-26T23:34:47.194726+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-26T23:34:47.194726+0000","last_undegraded":"2024-04-26T23:34:47.194726+0000","last_fullsized":"2024-04-26T23:34:47.194726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195194+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-26T23:34:47.195194+0000","last_peered":"2024-04-26T23:34:47.195194+0000","last_clean":"2024-04-26T23:34:47.195194+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-26T23:34:47.195194+0000","last_undegraded":"2024-04-26T23:34:47.195194+0000","last_fullsized":"2024-04-26T23:34:47.195194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105702+0000","last_change":"2024-04-26T23:34:45.073763+0000","last_active":"2024-04-26T23:34:47.105702+0000","last_peered":"2024-04-26T23:34:47.105702+0000","last_clean":"2024-04-26T23:34:47.105702+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-26T23:34:47.105702+0000","last_undegraded":"2024-04-26T23:34:47.105702+0000","last_fullsized":"2024-04-26T23:34:47.105702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:07.508274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199289+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-26T23:34:47.199289+0000","last_peered":"2024-04-26T23:34:47.199289+0000","last_clean":"2024-04-26T23:34:47.199289+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-26T23:34:47.199289+0000","last_undegraded":"2024-04-26T23:34:47.199289+0000","last_fullsized":"2024-04-26T23:34:47.199289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077282+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-26T23:34:47.077282+0000","last_peered":"2024-04-26T23:34:47.077282+0000","last_clean":"2024-04-26T23:34:47.077282+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-26T23:34:47.077282+0000","last_undegraded":"2024-04-26T23:34:47.077282+0000","last_fullsized":"2024-04-26T23:34:47.077282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073045+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-26T23:34:47.073045+0000","last_peered":"2024-04-26T23:34:47.073045+0000","last_clean":"2024-04-26T23:34:47.073045+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-26T23:34:47.073045+0000","last_undegraded":"2024-04-26T23:34:47.073045+0000","last_fullsized":"2024-04-26T23:34:47.073045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:03.761817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193193+0000","last_change":"2024-04-26T23:34:45.074276+0000","last_active":"2024-04-26T23:34:47.193193+0000","last_peered":"2024-04-26T23:34:47.193193+0000","last_clean":"2024-04-26T23:34:47.193193+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-26T23:34:47.193193+0000","last_undegraded":"2024-04-26T23:34:47.193193+0000","last_fullsized":"2024-04-26T23:34:47.193193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:33.430917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106164+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-26T23:34:47.106164+0000","last_peered":"2024-04-26T23:34:47.106164+0000","last_clean":"2024-04-26T23:34:47.106164+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-26T23:34:47.106164+0000","last_undegraded":"2024-04-26T23:34:47.106164+0000","last_fullsized":"2024-04-26T23:34:47.106164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077577+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-26T23:34:47.077577+0000","last_peered":"2024-04-26T23:34:47.077577+0000","last_clean":"2024-04-26T23:34:47.077577+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-26T23:34:47.077577+0000","last_undegraded":"2024-04-26T23:34:47.077577+0000","last_fullsized":"2024-04-26T23:34:47.077577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196880+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-26T23:34:47.196880+0000","last_peered":"2024-04-26T23:34:47.196880+0000","last_clean":"2024-04-26T23:34:47.196880+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-26T23:34:47.196880+0000","last_undegraded":"2024-04-26T23:34:47.196880+0000","last_fullsized":"2024-04-26T23:34:47.196880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073359+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-26T23:34:47.073359+0000","last_peered":"2024-04-26T23:34:47.073359+0000","last_clean":"2024-04-26T23:34:47.073359+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-26T23:34:47.073359+0000","last_undegraded":"2024-04-26T23:34:47.073359+0000","last_fullsized":"2024-04-26T23:34:47.073359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:49.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072955+0000","last_change":"2024-04-26T23:34:46.093800+0000","last_active":"2024-04-26T23:34:47.072955+0000","last_peered":"2024-04-26T23:34:47.072955+0000","last_clean":"2024-04-26T23:34:47.072955+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-26T23:34:47.072955+0000","last_undegraded":"2024-04-26T23:34:47.072955+0000","last_fullsized":"2024-04-26T23:34:47.072955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:07.701378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105379+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-26T23:34:47.105379+0000","last_peered":"2024-04-26T23:34:47.105379+0000","last_clean":"2024-04-26T23:34:47.105379+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-26T23:34:47.105379+0000","last_undegraded":"2024-04-26T23:34:47.105379+0000","last_fullsized":"2024-04-26T23:34:47.105379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195048+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-26T23:34:47.195048+0000","last_peered":"2024-04-26T23:34:47.195048+0000","last_clean":"2024-04-26T23:34:47.195048+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-26T23:34:47.195048+0000","last_undegraded":"2024-04-26T23:34:47.195048+0000","last_fullsized":"2024-04-26T23:34:47.195048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:08.523129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076152+0000","last_change":"2024-04-26T23:34:45.072379+0000","last_active":"2024-04-26T23:34:47.076152+0000","last_peered":"2024-04-26T23:34:47.076152+0000","last_clean":"2024-04-26T23:34:47.076152+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-26T23:34:47.076152+0000","last_undegraded":"2024-04-26T23:34:47.076152+0000","last_fullsized":"2024-04-26T23:34:47.076152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072186+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-26T23:34:47.072186+0000","last_peered":"2024-04-26T23:34:47.072186+0000","last_clean":"2024-04-26T23:34:47.072186+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-26T23:34:47.072186+0000","last_undegraded":"2024-04-26T23:34:47.072186+0000","last_fullsized":"2024-04-26T23:34:47.072186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106231+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-26T23:34:47.106231+0000","last_peered":"2024-04-26T23:34:47.106231+0000","last_clean":"2024-04-26T23:34:47.106231+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-26T23:34:47.106231+0000","last_undegraded":"2024-04-26T23:34:47.106231+0000","last_fullsized":"2024-04-26T23:34:47.106231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195501+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-26T23:34:47.195501+0000","last_peered":"2024-04-26T23:34:47.195501+0000","last_clean":"2024-04-26T23:34:47.195501+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-26T23:34:47.195501+0000","last_undegraded":"2024-04-26T23:34:47.195501+0000","last_fullsized":"2024-04-26T23:34:47.195501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076869+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-26T23:34:47.076869+0000","last_peered":"2024-04-26T23:34:47.076869+0000","last_clean":"2024-04-26T23:34:47.076869+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-26T23:34:47.076869+0000","last_undegraded":"2024-04-26T23:34:47.076869+0000","last_fullsized":"2024-04-26T23:34:47.076869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106140+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-26T23:34:47.106140+0000","last_peered":"2024-04-26T23:34:47.106140+0000","last_clean":"2024-04-26T23:34:47.106140+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-26T23:34:47.106140+0000","last_undegraded":"2024-04-26T23:34:47.106140+0000","last_fullsized":"2024-04-26T23:34:47.106140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198925+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-26T23:34:47.198925+0000","last_peered":"2024-04-26T23:34:47.198925+0000","last_clean":"2024-04-26T23:34:47.198925+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-26T23:34:47.198925+0000","last_undegraded":"2024-04-26T23:34:47.198925+0000","last_fullsized":"2024-04-26T23:34:47.198925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105774+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-26T23:34:47.105774+0000","last_peered":"2024-04-26T23:34:47.105774+0000","last_clean":"2024-04-26T23:34:47.105774+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-26T23:34:47.105774+0000","last_undegraded":"2024-04-26T23:34:47.105774+0000","last_fullsized":"2024-04-26T23:34:47.105774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196798+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-26T23:34:47.196798+0000","last_peered":"2024-04-26T23:34:47.196798+0000","last_clean":"2024-04-26T23:34:47.196798+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-26T23:34:47.196798+0000","last_undegraded":"2024-04-26T23:34:47.196798+0000","last_fullsized":"2024-04-26T23:34:47.196798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072553+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-26T23:34:47.072553+0000","last_peered":"2024-04-26T23:34:47.072553+0000","last_clean":"2024-04-26T23:34:47.072553+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-26T23:34:47.072553+0000","last_undegraded":"2024-04-26T23:34:47.072553+0000","last_fullsized":"2024-04-26T23:34:47.072553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:10.277157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.192890+0000","last_change":"2024-04-26T23:34:41.212862+0000","last_active":"2024-04-26T23:34:47.192890+0000","last_peered":"2024-04-26T23:34:47.192890+0000","last_clean":"2024-04-26T23:34:47.192890+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-26T23:34:47.192890+0000","last_undegraded":"2024-04-26T23:34:47.192890+0000","last_fullsized":"2024-04-26T23:34:47.192890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_clean_scrub_stamp":"2024-04-26T23:34:39.876770+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:44.232023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073259+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-26T23:34:47.073259+0000","last_peered":"2024-04-26T23:34:47.073259+0000","last_clean":"2024-04-26T23:34:47.073259+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-26T23:34:47.073259+0000","last_undegraded":"2024-04-26T23:34:47.073259+0000","last_fullsized":"2024-04-26T23:34:47.073259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:35.809938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076511+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-26T23:34:47.076511+0000","last_peered":"2024-04-26T23:34:47.076511+0000","last_clean":"2024-04-26T23:34:47.076511+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-26T23:34:47.076511+0000","last_undegraded":"2024-04-26T23:34:47.076511+0000","last_fullsized":"2024-04-26T23:34:47.076511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072426+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-26T23:34:47.072426+0000","last_peered":"2024-04-26T23:34:47.072426+0000","last_clean":"2024-04-26T23:34:47.072426+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-26T23:34:47.072426+0000","last_undegraded":"2024-04-26T23:34:47.072426+0000","last_fullsized":"2024-04-26T23:34:47.072426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.195191+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-26T23:34:47.195191+0000","last_peered":"2024-04-26T23:34:47.195191+0000","last_clean":"2024-04-26T23:34:47.195191+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-26T23:34:47.195191+0000","last_undegraded":"2024-04-26T23:34:47.195191+0000","last_fullsized":"2024-04-26T23:34:47.195191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.075729+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-26T23:34:47.075729+0000","last_peered":"2024-04-26T23:34:47.075729+0000","last_clean":"2024-04-26T23:34:47.075729+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-26T23:34:47.075729+0000","last_undegraded":"2024-04-26T23:34:47.075729+0000","last_fullsized":"2024-04-26T23:34:47.075729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198333+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-26T23:34:47.198333+0000","last_peered":"2024-04-26T23:34:47.198333+0000","last_clean":"2024-04-26T23:34:47.198333+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-26T23:34:47.198333+0000","last_undegraded":"2024-04-26T23:34:47.198333+0000","last_fullsized":"2024-04-26T23:34:47.198333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073439+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-26T23:34:47.073439+0000","last_peered":"2024-04-26T23:34:47.073439+0000","last_clean":"2024-04-26T23:34:47.073439+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-26T23:34:47.073439+0000","last_undegraded":"2024-04-26T23:34:47.073439+0000","last_fullsized":"2024-04-26T23:34:47.073439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:21.723421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105537+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-26T23:34:47.105537+0000","last_peered":"2024-04-26T23:34:47.105537+0000","last_clean":"2024-04-26T23:34:47.105537+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-26T23:34:47.105537+0000","last_undegraded":"2024-04-26T23:34:47.105537+0000","last_fullsized":"2024-04-26T23:34:47.105537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.198599+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-26T23:34:47.198599+0000","last_peered":"2024-04-26T23:34:47.198599+0000","last_clean":"2024-04-26T23:34:47.198599+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-26T23:34:47.198599+0000","last_undegraded":"2024-04-26T23:34:47.198599+0000","last_fullsized":"2024-04-26T23:34:47.198599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.193652+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-26T23:34:47.193652+0000","last_peered":"2024-04-26T23:34:47.193652+0000","last_clean":"2024-04-26T23:34:47.193652+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-26T23:34:47.193652+0000","last_undegraded":"2024-04-26T23:34:47.193652+0000","last_fullsized":"2024-04-26T23:34:47.193652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072874+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-26T23:34:47.072874+0000","last_peered":"2024-04-26T23:34:47.072874+0000","last_clean":"2024-04-26T23:34:47.072874+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-26T23:34:47.072874+0000","last_undegraded":"2024-04-26T23:34:47.072874+0000","last_fullsized":"2024-04-26T23:34:47.072874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:33.819205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196711+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-26T23:34:47.196711+0000","last_peered":"2024-04-26T23:34:47.196711+0000","last_clean":"2024-04-26T23:34:47.196711+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-26T23:34:47.196711+0000","last_undegraded":"2024-04-26T23:34:47.196711+0000","last_fullsized":"2024-04-26T23:34:47.196711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.103576+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-26T23:34:47.103576+0000","last_peered":"2024-04-26T23:34:47.103576+0000","last_clean":"2024-04-26T23:34:47.103576+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-26T23:34:47.103576+0000","last_undegraded":"2024-04-26T23:34:47.103576+0000","last_fullsized":"2024-04-26T23:34:47.103576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077018+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-26T23:34:47.077018+0000","last_peered":"2024-04-26T23:34:47.077018+0000","last_clean":"2024-04-26T23:34:47.077018+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-26T23:34:47.077018+0000","last_undegraded":"2024-04-26T23:34:47.077018+0000","last_fullsized":"2024-04-26T23:34:47.077018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072779+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-26T23:34:47.072779+0000","last_peered":"2024-04-26T23:34:47.072779+0000","last_clean":"2024-04-26T23:34:47.072779+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-26T23:34:47.072779+0000","last_undegraded":"2024-04-26T23:34:47.072779+0000","last_fullsized":"2024-04-26T23:34:47.072779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:19.687355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076579+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-26T23:34:47.076579+0000","last_peered":"2024-04-26T23:34:47.076579+0000","last_clean":"2024-04-26T23:34:47.076579+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-26T23:34:47.076579+0000","last_undegraded":"2024-04-26T23:34:47.076579+0000","last_fullsized":"2024-04-26T23:34:47.076579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105602+0000","last_change":"2024-04-26T23:34:45.076058+0000","last_active":"2024-04-26T23:34:47.105602+0000","last_peered":"2024-04-26T23:34:47.105602+0000","last_clean":"2024-04-26T23:34:47.105602+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-26T23:34:47.105602+0000","last_undegraded":"2024-04-26T23:34:47.105602+0000","last_fullsized":"2024-04-26T23:34:47.105602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072971+0000","last_change":"2024-04-26T23:34:46.092601+0000","last_active":"2024-04-26T23:34:47.072971+0000","last_peered":"2024-04-26T23:34:47.072971+0000","last_clean":"2024-04-26T23:34:47.072971+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-26T23:34:47.072971+0000","last_undegraded":"2024-04-26T23:34:47.072971+0000","last_fullsized":"2024-04-26T23:34:47.072971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:01.319097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.076569+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-26T23:34:47.076569+0000","last_peered":"2024-04-26T23:34:47.076569+0000","last_clean":"2024-04-26T23:34:47.076569+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-26T23:34:47.076569+0000","last_undegraded":"2024-04-26T23:34:47.076569+0000","last_fullsized":"2024-04-26T23:34:47.076569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077738+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-26T23:34:47.077738+0000","last_peered":"2024-04-26T23:34:47.077738+0000","last_clean":"2024-04-26T23:34:47.077738+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-26T23:34:47.077738+0000","last_undegraded":"2024-04-26T23:34:47.077738+0000","last_fullsized":"2024-04-26T23:34:47.077738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.196010+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-26T23:34:47.196010+0000","last_peered":"2024-04-26T23:34:47.196010+0000","last_clean":"2024-04-26T23:34:47.196010+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-26T23:34:47.196010+0000","last_undegraded":"2024-04-26T23:34:47.196010+0000","last_fullsized":"2024-04-26T23:34:47.196010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077281+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-26T23:34:47.077281+0000","last_peered":"2024-04-26T23:34:47.077281+0000","last_clean":"2024-04-26T23:34:47.077281+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-26T23:34:47.077281+0000","last_undegraded":"2024-04-26T23:34:47.077281+0000","last_fullsized":"2024-04-26T23:34:47.077281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.073024+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-26T23:34:47.073024+0000","last_peered":"2024-04-26T23:34:47.073024+0000","last_clean":"2024-04-26T23:34:47.073024+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-26T23:34:47.073024+0000","last_undegraded":"2024-04-26T23:34:47.073024+0000","last_fullsized":"2024-04-26T23:34:47.073024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:35.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072912+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-26T23:34:47.072912+0000","last_peered":"2024-04-26T23:34:47.072912+0000","last_clean":"2024-04-26T23:34:47.072912+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-26T23:34:47.072912+0000","last_undegraded":"2024-04-26T23:34:47.072912+0000","last_fullsized":"2024-04-26T23:34:47.072912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:37.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.072327+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-26T23:34:47.072327+0000","last_peered":"2024-04-26T23:34:47.072327+0000","last_clean":"2024-04-26T23:34:47.072327+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-26T23:34:47.072327+0000","last_undegraded":"2024-04-26T23:34:47.072327+0000","last_fullsized":"2024-04-26T23:34:47.072327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.105857+0000","last_change":"2024-04-26T23:34:45.075234+0000","last_active":"2024-04-26T23:34:47.105857+0000","last_peered":"2024-04-26T23:34:47.105857+0000","last_clean":"2024-04-26T23:34:47.105857+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-26T23:34:47.105857+0000","last_undegraded":"2024-04-26T23:34:47.105857+0000","last_fullsized":"2024-04-26T23:34:47.105857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.194840+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-26T23:34:47.194840+0000","last_peered":"2024-04-26T23:34:47.194840+0000","last_clean":"2024-04-26T23:34:47.194840+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-26T23:34:47.194840+0000","last_undegraded":"2024-04-26T23:34:47.194840+0000","last_fullsized":"2024-04-26T23:34:47.194840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.106263+0000","last_change":"2024-04-26T23:34:45.074596+0000","last_active":"2024-04-26T23:34:47.106263+0000","last_peered":"2024-04-26T23:34:47.106263+0000","last_clean":"2024-04-26T23:34:47.106263+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-26T23:34:47.106263+0000","last_undegraded":"2024-04-26T23:34:47.106263+0000","last_fullsized":"2024-04-26T23:34:47.106263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199369+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-26T23:34:47.199369+0000","last_peered":"2024-04-26T23:34:47.199369+0000","last_clean":"2024-04-26T23:34:47.199369+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-26T23:34:47.199369+0000","last_undegraded":"2024-04-26T23:34:47.199369+0000","last_fullsized":"2024-04-26T23:34:47.199369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199395+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-26T23:34:47.199395+0000","last_peered":"2024-04-26T23:34:47.199395+0000","last_clean":"2024-04-26T23:34:47.199395+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-26T23:34:47.199395+0000","last_undegraded":"2024-04-26T23:34:47.199395+0000","last_fullsized":"2024-04-26T23:34:47.199395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.199201+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-26T23:34:47.199201+0000","last_peered":"2024-04-26T23:34:47.199201+0000","last_clean":"2024-04-26T23:34:47.199201+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-26T23:34:47.199201+0000","last_undegraded":"2024-04-26T23:34:47.199201+0000","last_fullsized":"2024-04-26T23:34:47.199201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:34:47.077353+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-26T23:34:47.077353+0000","last_peered":"2024-04-26T23:34:47.077353+0000","last_clean":"2024-04-26T23:34:47.077353+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-26T23:34:47.077353+0000","last_undegraded":"2024-04-26T23:34:47.077353+0000","last_fullsized":"2024-04-26T23:34:47.077353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":70990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:34:56.714 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:34:56.714 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T23:34:56.714 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T23:34:56.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T23:34:56.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.955+0000 7f40c4e00640 1 Processor -- start 2024-04-26T23:34:56.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.955+0000 7f40c4e00640 1 -- start start 2024-04-26T23:34:56.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40c4e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40c014fec0 0x7f40c01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40c4e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f40c0073b80 0x7f40c01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40c4e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c00b1980 con 0x7f40c00b9e60 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40c4e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f40c00ba240 con 0x7f40c0073b80 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40c4e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f40c00b30b0 con 0x7f40c014fec0 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40bfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f40c0073b80 0x7f40c01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40bfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f40c0073b80 0x7f40c01571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48844/0 (socket says 172.21.15.16:48844) 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.957+0000 7f40bfe00640 1 -- 172.21.15.16:0/2483483857 learned_addr learned my addr 172.21.15.16:0/2483483857 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.958+0000 7f40bea00640 1 --2- 172.21.15.16:0/2483483857 >> v2:172.21.15.32:3300/0 conn(0x7f40c014fec0 0x7f40c01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.958+0000 7f40bfe00640 1 -- 172.21.15.16:0/2483483857 >> v2:172.21.15.32:3300/0 conn(0x7f40c014fec0 msgr2=0x7f40c01505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.958+0000 7f40bfe00640 1 --2- 172.21.15.16:0/2483483857 >> v2:172.21.15.32:3300/0 conn(0x7f40c014fec0 0x7f40c01505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.958+0000 7f40bfe00640 1 -- 172.21.15.16:0/2483483857 >> v1:172.21.15.32:6789/0 conn(0x7f40c00b9e60 legacy=0x7f40c00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:56.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.958+0000 7f40bfe00640 1 -- 172.21.15.16:0/2483483857 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c00b16a0 con 0x7f40c0073b80 2024-04-26T23:34:56.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.958+0000 7f40bea00640 1 --2- 172.21.15.16:0/2483483857 >> v2:172.21.15.32:3300/0 conn(0x7f40c014fec0 0x7f40c01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.959+0000 7f40bfe00640 1 --2- 172.21.15.16:0/2483483857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01571f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40c006e910 tx=0x7f40b802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb8a2756683e850 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.959+0000 7f40be000640 1 -- 172.21.15.16:0/2483483857 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8036070 con 0x7f40c0073b80 2024-04-26T23:34:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.959+0000 7f40be000640 1 -- 172.21.15.16:0/2483483857 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b8031600 con 0x7f40c0073b80 2024-04-26T23:34:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.959+0000 7f40be000640 1 -- 172.21.15.16:0/2483483857 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80319d0 con 0x7f40c0073b80 2024-04-26T23:34:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.959+0000 7f40c4e00640 1 -- 172.21.15.16:0/2483483857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 msgr2=0x7f40c01571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.959+0000 7f40c4e00640 1 --2- 172.21.15.16:0/2483483857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01571f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40c006e910 tx=0x7f40b802a6f0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.960+0000 7f40c4e00640 1 -- 172.21.15.16:0/2483483857 shutdown_connections 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.960+0000 7f40c4e00640 1 --2- 172.21.15.16:0/2483483857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01571f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.960+0000 7f40c4e00640 1 --2- 172.21.15.16:0/2483483857 >> v2:172.21.15.32:3300/0 conn(0x7f40c014fec0 0x7f40c01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.960+0000 7f40c4e00640 1 -- 172.21.15.16:0/2483483857 >> 172.21.15.16:0/2483483857 conn(0x7f40c006d410 msgr2=0x7f40c006d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.960+0000 7f40c4e00640 1 -- 172.21.15.16:0/2483483857 shutdown_connections 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.960+0000 7f40c4e00640 1 -- 172.21.15.16:0/2483483857 wait complete. 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.961+0000 7f40c4e00640 1 Processor -- start 2024-04-26T23:34:56.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.961+0000 7f40c4e00640 1 -- start start 2024-04-26T23:34:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40c4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01d72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40c4e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40c00b9e60 0x7f40c01d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40c4e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40c014fec0 0x7f40c0149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40c4e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40c00b1050 con 0x7f40c0073b80 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40c4e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f40c00b5fe0 con 0x7f40c014fec0 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40c4e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f40c0150b10 con 0x7f40c00b9e60 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40bf400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01d72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40bf400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01d72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48850/0 (socket says 172.21.15.16:48850) 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.962+0000 7f40bf400640 1 -- 172.21.15.16:0/1980491140 learned_addr learned my addr 172.21.15.16:0/1980491140 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bfe00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40c014fec0 0x7f40c0149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bea00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40c00b9e60 0x7f40c01d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bf400640 1 -- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40c00b9e60 msgr2=0x7f40c01d6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bf400640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40c00b9e60 0x7f40c01d6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bf400640 1 -- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40c014fec0 msgr2=0x7f40c0149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bf400640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40c014fec0 0x7f40c0149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bf400640 1 -- 172.21.15.16:0/1980491140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c01d7820 con 0x7f40c0073b80 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40bf400640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01d72e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c460 tx=0x7f40b000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40b7400640 1 -- 172.21.15.16:0/1980491140 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0016020 con 0x7f40c0073b80 2024-04-26T23:34:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40b7400640 1 -- 172.21.15.16:0/1980491140 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b0012870 con 0x7f40c0073b80 2024-04-26T23:34:56.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40b7400640 1 -- 172.21.15.16:0/1980491140 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0012c60 con 0x7f40c0073b80 2024-04-26T23:34:56.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.963+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c01d7aa0 con 0x7f40c0073b80 2024-04-26T23:34:56.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.964+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c01d8340 con 0x7f40c0073b80 2024-04-26T23:34:56.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.965+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c0076600 con 0x7f40c0073b80 2024-04-26T23:34:56.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.966+0000 7f40b7400640 1 -- 172.21.15.16:0/1980491140 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f40b0019020 con 0x7f40c0073b80 2024-04-26T23:34:56.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.967+0000 7f40b7400640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f40a006c8f0 0x7f40a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:56.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.967+0000 7f40b7400640 1 -- 172.21.15.16:0/1980491140 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f40b008bc10 con 0x7f40c0073b80 2024-04-26T23:34:56.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.967+0000 7f40bea00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f40a006c8f0 0x7f40a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:56.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.968+0000 7f40bea00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f40a006c8f0 0x7f40a006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40c014e610 tx=0x7f40ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:56.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:56.971+0000 7f40b7400640 1 -- 172.21.15.16:0/1980491140 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f40b0020020 con 0x7f40c0073b80 2024-04-26T23:34:57.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.222+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f40c00b2dd0 con 0x7f40c0073b80 2024-04-26T23:34:57.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.223+0000 7f40b7400640 1 -- 172.21.15.16:0/1980491140 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f40c01d7820 con 0x7f40c0073b80 2024-04-26T23:34:57.227 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:57.227 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f40a006c8f0 msgr2=0x7f40a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f40a006c8f0 0x7f40a006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40c014e610 tx=0x7f40ac008040 comp rx=0 tx=0).stop 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 msgr2=0x7f40c01d72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01d72e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c460 tx=0x7f40b000c920 comp rx=0 tx=0).stop 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 shutdown_connections 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f40a006c8f0 0x7f40a006edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40c014fec0 0x7f40c0149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40c00b9e60 0x7f40c01d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 --2- 172.21.15.16:0/1980491140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c0073b80 0x7f40c01d72e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.226+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 >> 172.21.15.16:0/1980491140 conn(0x7f40c006d410 msgr2=0x7f40c014c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:57.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.227+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 shutdown_connections 2024-04-26T23:34:57.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.227+0000 7f40c4e00640 1 -- 172.21.15.16:0/1980491140 wait complete. 2024-04-26T23:34:57.250 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T23:34:57.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:57.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.461+0000 7f74d3e00640 1 Processor -- start 2024-04-26T23:34:57.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.462+0000 7f74d3e00640 1 -- start start 2024-04-26T23:34:57.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.463+0000 7f74d3e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74d41422e0 0x7f74d4142770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.463+0000 7f74d3e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d414daf0 0x7f74d414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.463+0000 7f74d3e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d4070c80 con 0x7f74d4075550 2024-04-26T23:34:57.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.463+0000 7f74d3e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f74d40b3820 con 0x7f74d41422e0 2024-04-26T23:34:57.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.463+0000 7f74d3e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f74d4075930 con 0x7f74d414daf0 2024-04-26T23:34:57.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.463+0000 7f74d2a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f74d4075550 0x7f74d40b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41138/0 (socket says 172.21.15.16:41138) 2024-04-26T23:34:57.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.463+0000 7f74d2a00640 1 -- 172.21.15.16:0/1853731862 learned_addr learned my addr 172.21.15.16:0/1853731862 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d3400640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d414daf0 0x7f74d414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d2000640 1 --2- 172.21.15.16:0/1853731862 >> v2:172.21.15.32:3300/0 conn(0x7f74d41422e0 0x7f74d4142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229350660 0 0) 0x7f74d4070c80 con 0x7f74d4075550 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74b8003520 con 0x7f74d4075550 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1699998892 0 0) 0x7f74b8003520 con 0x7f74d4075550 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d414daf0 msgr2=0x7f74d414fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d414daf0 0x7f74d414fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 >> v2:172.21.15.32:3300/0 conn(0x7f74d41422e0 msgr2=0x7f74d4142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 --2- 172.21.15.16:0/1853731862 >> v2:172.21.15.32:3300/0 conn(0x7f74d41422e0 0x7f74d4142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d40b3cb0 con 0x7f74d4075550 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f74bc001670 con 0x7f74d4075550 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 >> v1:172.21.15.16:6789/0 conn(0x7f74d4075550 legacy=0x7f74d40b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74b8004800 0x7f74b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74b8005210 0x7f74b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74d40b3820 con 0x7f74b80039b0 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4075930 con 0x7f74b8004800 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f74b800c140 con 0x7f74b8005210 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d3400640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d414daf0 0x7f74d414fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.464+0000 7f74d2000640 1 --2- 172.21.15.16:0/1853731862 >> v2:172.21.15.32:3300/0 conn(0x7f74d41422e0 0x7f74d4142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:34:57.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.465+0000 7f74d2a00640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.465+0000 7f74d2a00640 1 -- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74b8005210 msgr2=0x7f74b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:57.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.465+0000 7f74d2a00640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74b8005210 0x7f74b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.465+0000 7f74d2a00640 1 -- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74b8004800 msgr2=0x7f74b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:57.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.465+0000 7f74d2a00640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74b8004800 0x7f74b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.465+0000 7f74d2a00640 1 -- 172.21.15.16:0/1853731862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b8003520 con 0x7f74b80039b0 2024-04-26T23:34:57.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.466+0000 7f74d2a00640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74b8003dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c210 tx=0x7f74b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd07b5b53639881e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.466+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc007d50 con 0x7f74b80039b0 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.466+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74bc005af0 con 0x7f74b80039b0 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.466+0000 7f74d1600640 1 -- 172.21.15.16:0/1853731862 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc007070 con 0x7f74b80039b0 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.467+0000 7f74d3e00640 1 -- 172.21.15.16:0/1853731862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 msgr2=0x7f74b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.467+0000 7f74d3e00640 1 --2- 172.21.15.16:0/1853731862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74b8003dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c210 tx=0x7f74b8005830 comp rx=0 tx=0).stop 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.467+0000 7f74d3400640 1 -- 172.21.15.16:0/1853731862 reap_dead start 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.467+0000 7f74d3e00640 1 -- 172.21.15.16:0/1853731862 shutdown_connections 2024-04-26T23:34:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.467+0000 7f74d3e00640 1 -- 172.21.15.16:0/1853731862 >> 172.21.15.16:0/1853731862 conn(0x7f74d40ba0e0 msgr2=0x7f74d40ba4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:57.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.467+0000 7f74d3e00640 1 -- 172.21.15.16:0/1853731862 shutdown_connections 2024-04-26T23:34:57.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.467+0000 7f74d3e00640 1 -- 172.21.15.16:0/1853731862 wait complete. 2024-04-26T23:34:57.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.469+0000 7f74d3e00640 1 Processor -- start 2024-04-26T23:34:57.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.470+0000 7f74d3e00640 1 -- start start 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74d4141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d3e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d41dbd30 0x7f74d4141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d3e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d41d8730 0x7f74d41d8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d3e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4070ef0 con 0x7f74b80039b0 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d3e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f74d40b65f0 con 0x7f74d41d8730 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d3e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f74d41487d0 con 0x7f74d41dbd30 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74d4141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74d4141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48876/0 (socket says 172.21.15.16:48876) 2024-04-26T23:34:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d2a00640 1 -- 172.21.15.16:0/630620711 learned_addr learned my addr 172.21.15.16:0/630620711 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d2000640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d41dbd30 0x7f74d4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d3400640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d41d8730 0x7f74d41d8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d2a00640 1 -- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d41dbd30 msgr2=0x7f74d4141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d2a00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d41dbd30 0x7f74d4141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.471+0000 7f74d2a00640 1 -- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d41d8730 msgr2=0x7f74d41d8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74d2a00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d41d8730 0x7f74d41d8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74d2a00640 1 -- 172.21.15.16:0/630620711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d41dc1f0 con 0x7f74b80039b0 2024-04-26T23:34:57.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74d2a00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74d4141440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001970 tx=0x7f74bc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74caa00640 1 -- 172.21.15.16:0/630620711 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc042070 con 0x7f74b80039b0 2024-04-26T23:34:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74caa00640 1 -- 172.21.15.16:0/630620711 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74bc0074a0 con 0x7f74b80039b0 2024-04-26T23:34:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74caa00640 1 -- 172.21.15.16:0/630620711 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc001c90 con 0x7f74b80039b0 2024-04-26T23:34:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d41dc4d0 con 0x7f74b80039b0 2024-04-26T23:34:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.472+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d40b9ac0 con 0x7f74b80039b0 2024-04-26T23:34:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.474+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d4076600 con 0x7f74b80039b0 2024-04-26T23:34:57.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.475+0000 7f74caa00640 1 -- 172.21.15.16:0/630620711 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74bc045070 con 0x7f74b80039b0 2024-04-26T23:34:57.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.475+0000 7f74caa00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.476+0000 7f74caa00640 1 -- 172.21.15.16:0/630620711 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f74bc0ac710 con 0x7f74b80039b0 2024-04-26T23:34:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.476+0000 7f74d2000640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.477+0000 7f74d2000640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f74b006c8f0 0x7f74b006edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74d40b2710 tx=0x7f74c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.480+0000 7f74caa00640 1 -- 172.21.15.16:0/630620711 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f74bc005ac0 con 0x7f74b80039b0 2024-04-26T23:34:57.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.683+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74d41dc6d0 con 0x7f74b80039b0 2024-04-26T23:34:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.685+0000 7f74caa00640 1 -- 172.21.15.16:0/630620711 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16561 (secure 0 0 0) 0x7f74bc07a4e0 con 0x7f74b80039b0 2024-04-26T23:34:57.688 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:57.689 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:47.057746+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f74b006c8f0 msgr2=0x7f74b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f74b006c8f0 0x7f74b006edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74d40b2710 tx=0x7f74c4008040 comp rx=0 tx=0).stop 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 msgr2=0x7f74d4141440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74d4141440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001970 tx=0x7f74bc001a40 comp rx=0 tx=0).stop 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 shutdown_connections 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d41d8730 0x7f74d41d8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f74d41dbd30 0x7f74d4141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 --2- 172.21.15.16:0/630620711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74b80039b0 0x7f74d4141440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.687+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 >> 172.21.15.16:0/630620711 conn(0x7f74d40ba0e0 msgr2=0x7f74d40b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.688+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 shutdown_connections 2024-04-26T23:34:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.688+0000 7f74d3e00640 1 -- 172.21.15.16:0/630620711 wait complete. 2024-04-26T23:34:57.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:34:39.843396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:34:43.895977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:34:44.517438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:34:57.709 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:34:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.897+0000 7f4135200640 1 Processor -- start 2024-04-26T23:34:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.898+0000 7f4135200640 1 -- start start 2024-04-26T23:34:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f4135200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f41300b6940 0x7f41301498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f4135200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41300b5640 0x7f4130149e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f4135200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 0x7f4130140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f4135200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f41300b3af0 con 0x7f41300b5640 2024-04-26T23:34:57.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f4135200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f4130070680 con 0x7f41300b6940 2024-04-26T23:34:57.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f4135200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f41300718e0 con 0x7f413013ff40 2024-04-26T23:34:57.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f412ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41300b5640 0x7f4130149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f412ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41300b5640 0x7f4130149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48882/0 (socket says 172.21.15.16:48882) 2024-04-26T23:34:57.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.899+0000 7f412ea00640 1 -- 172.21.15.16:0/779955310 learned_addr learned my addr 172.21.15.16:0/779955310 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412fe00640 1 --2- 172.21.15.16:0/779955310 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 0x7f4130140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412f400640 1 --2- 172.21.15.16:0/779955310 >> v2:172.21.15.32:3300/0 conn(0x7f41300b6940 0x7f41301498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412ea00640 1 -- 172.21.15.16:0/779955310 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 msgr2=0x7f4130140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412ea00640 1 --2- 172.21.15.16:0/779955310 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 0x7f4130140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412ea00640 1 -- 172.21.15.16:0/779955310 >> v2:172.21.15.32:3300/0 conn(0x7f41300b6940 msgr2=0x7f41301498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412ea00640 1 --2- 172.21.15.16:0/779955310 >> v2:172.21.15.32:3300/0 conn(0x7f41300b6940 0x7f41301498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412ea00640 1 -- 172.21.15.16:0/779955310 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41300b6d20 con 0x7f41300b5640 2024-04-26T23:34:57.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.900+0000 7f412f400640 1 --2- 172.21.15.16:0/779955310 >> v2:172.21.15.32:3300/0 conn(0x7f41300b6940 0x7f41301498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:34:57.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.901+0000 7f412ea00640 1 --2- 172.21.15.16:0/779955310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b5640 0x7f4130149e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f41300b7270 tx=0x7f411c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acad4896163e7bac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.901+0000 7f412e000640 1 -- 172.21.15.16:0/779955310 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c037070 con 0x7f41300b5640 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.901+0000 7f412e000640 1 -- 172.21.15.16:0/779955310 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411c032440 con 0x7f41300b5640 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.901+0000 7f412e000640 1 -- 172.21.15.16:0/779955310 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c032810 con 0x7f41300b5640 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 -- 172.21.15.16:0/779955310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b5640 msgr2=0x7f4130149e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 --2- 172.21.15.16:0/779955310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b5640 0x7f4130149e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f41300b7270 tx=0x7f411c02a140 comp rx=0 tx=0).stop 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 -- 172.21.15.16:0/779955310 shutdown_connections 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 --2- 172.21.15.16:0/779955310 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 0x7f4130140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 --2- 172.21.15.16:0/779955310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b5640 0x7f4130149e20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 --2- 172.21.15.16:0/779955310 >> v2:172.21.15.32:3300/0 conn(0x7f41300b6940 0x7f41301498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 -- 172.21.15.16:0/779955310 >> 172.21.15.16:0/779955310 conn(0x7f4130068270 msgr2=0x7f4130068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 -- 172.21.15.16:0/779955310 shutdown_connections 2024-04-26T23:34:57.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.902+0000 7f4135200640 1 -- 172.21.15.16:0/779955310 wait complete. 2024-04-26T23:34:57.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.903+0000 7f4135200640 1 Processor -- start 2024-04-26T23:34:57.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.904+0000 7f4135200640 1 -- start start 2024-04-26T23:34:57.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.904+0000 7f4135200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41300b5640 0x7f41300b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.904+0000 7f4135200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b6940 0x7f41301db490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.904+0000 7f4135200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 0x7f41300af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.904+0000 7f4135200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41300b3d10 con 0x7f41300b6940 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.904+0000 7f4135200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f41301408b0 con 0x7f41300b5640 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.904+0000 7f4135200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f41300b3710 con 0x7f413013ff40 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b6940 0x7f41301db490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b6940 0x7f41301db490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48884/0 (socket says 172.21.15.16:48884) 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 -- 172.21.15.16:0/3754053896 learned_addr learned my addr 172.21.15.16:0/3754053896 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 -- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 msgr2=0x7f41300af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 0x7f41300af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 -- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41300b5640 msgr2=0x7f41300b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:57.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41300b5640 0x7f41300b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:57.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 -- 172.21.15.16:0/3754053896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41301deba0 con 0x7f41300b6940 2024-04-26T23:34:57.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.905+0000 7f412ea00640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b6940 0x7f41301db490 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f411c02a180 tx=0x7f411c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:57.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.906+0000 7f4127400640 1 -- 172.21.15.16:0/3754053896 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c041020 con 0x7f41300b6940 2024-04-26T23:34:57.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.906+0000 7f4127400640 1 -- 172.21.15.16:0/3754053896 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411c0306c0 con 0x7f41300b6940 2024-04-26T23:34:57.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.906+0000 7f4127400640 1 -- 172.21.15.16:0/3754053896 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c037040 con 0x7f41300b6940 2024-04-26T23:34:57.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.906+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41300aaed0 con 0x7f41300b6940 2024-04-26T23:34:57.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.906+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41301dee40 con 0x7f41300b6940 2024-04-26T23:34:57.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.907+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4130076600 con 0x7f41300b6940 2024-04-26T23:34:57.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.908+0000 7f4127400640 1 -- 172.21.15.16:0/3754053896 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f411c044020 con 0x7f41300b6940 2024-04-26T23:34:57.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.909+0000 7f4127400640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f411006c8f0 0x7f411006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:57.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.909+0000 7f4127400640 1 -- 172.21.15.16:0/3754053896 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f411c0ac320 con 0x7f41300b6940 2024-04-26T23:34:57.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.909+0000 7f412f400640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f411006c8f0 0x7f411006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:57.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.910+0000 7f412f400640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f411006c8f0 0x7f411006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4120006fd0 tx=0x7f4120008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:57.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:57.913+0000 7f4127400640 1 -- 172.21.15.16:0/3754053896 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f411c04b030 con 0x7f41300b6940 2024-04-26T23:34:58.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.115+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41300ab1b0 con 0x7f41300b6940 2024-04-26T23:34:58.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.116+0000 7f4127400640 1 -- 172.21.15.16:0/3754053896 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f411c07a740 con 0x7f41300b6940 2024-04-26T23:34:58.119 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T23:34:58.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f411006c8f0 msgr2=0x7f411006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f411006c8f0 0x7f411006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4120006fd0 tx=0x7f4120008040 comp rx=0 tx=0).stop 2024-04-26T23:34:58.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b6940 msgr2=0x7f41301db490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b6940 0x7f41301db490 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f411c02a180 tx=0x7f411c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 shutdown_connections 2024-04-26T23:34:58.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f411006c8f0 0x7f411006edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f413013ff40 0x7f41300af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41300b6940 0x7f41301db490 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 --2- 172.21.15.16:0/3754053896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41300b5640 0x7f41300b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.118+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 >> 172.21.15.16:0/3754053896 conn(0x7f4130068270 msgr2=0x7f4130146210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:58.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.119+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 shutdown_connections 2024-04-26T23:34:58.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.119+0000 7f4135200640 1 -- 172.21.15.16:0/3754053896 wait complete. 2024-04-26T23:34:58.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:34:58.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.351+0000 7fe6cb200640 1 Processor -- start 2024-04-26T23:34:58.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.351+0000 7fe6cb200640 1 -- start start 2024-04-26T23:34:58.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.353+0000 7fe6cb200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe6cc0b5640 0x7fe6cc13ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.353+0000 7fe6cb200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6cc0718e0 con 0x7fe6cc0b6940 2024-04-26T23:34:58.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.353+0000 7fe6cb200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6cc0b6d20 con 0x7fe6cc149ff0 2024-04-26T23:34:58.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.353+0000 7fe6cb200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe6cc0b3af0 con 0x7fe6cc0b5640 2024-04-26T23:34:58.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.353+0000 7fe6c9e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe6cc0b6940 0x7fe6cc1498e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41148/0 (socket says 172.21.15.16:41148) 2024-04-26T23:34:58.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.353+0000 7fe6c9e00640 1 -- 172.21.15.16:0/732924724 learned_addr learned my addr 172.21.15.16:0/732924724 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:58.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.353+0000 7fe6c3e00640 1 --2- 172.21.15.16:0/732924724 >> v2:172.21.15.16:3300/0 conn(0x7fe6cc0b5640 0x7fe6cc13ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.354+0000 7fe6c9400640 1 -- 172.21.15.16:0/732924724 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149198795 0 0) 0x7fe6cc0718e0 con 0x7fe6cc0b6940 2024-04-26T23:34:58.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.354+0000 7fe6c9400640 1 -- 172.21.15.16:0/732924724 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6b0003520 con 0x7fe6cc0b6940 2024-04-26T23:34:58.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.354+0000 7fe6c3e00640 1 -- 172.21.15.16:0/732924724 >> v1:172.21.15.32:6789/0 conn(0x7fe6cc149ff0 legacy=0x7fe6cc150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.354+0000 7fe6c3e00640 1 -- 172.21.15.16:0/732924724 >> v1:172.21.15.16:6789/0 conn(0x7fe6cc0b6940 legacy=0x7fe6cc1498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.354+0000 7fe6c3e00640 1 -- 172.21.15.16:0/732924724 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc070310 con 0x7fe6cc0b5640 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.355+0000 7fe6c3e00640 1 --2- 172.21.15.16:0/732924724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b5640 0x7fe6cc13ff40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40097a0 tx=0x7fe6b402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b86d47593b23a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.355+0000 7fe6c9400640 1 -- 172.21.15.16:0/732924724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4037070 con 0x7fe6cc0b5640 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.355+0000 7fe6c9400640 1 -- 172.21.15.16:0/732924724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b4032440 con 0x7fe6cc0b5640 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.355+0000 7fe6c9400640 1 -- 172.21.15.16:0/732924724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4032810 con 0x7fe6cc0b5640 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.355+0000 7fe6cb200640 1 -- 172.21.15.16:0/732924724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b5640 msgr2=0x7fe6cc13ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.355+0000 7fe6cb200640 1 --2- 172.21.15.16:0/732924724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b5640 0x7fe6cc13ff40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40097a0 tx=0x7fe6b402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.356+0000 7fe6cb200640 1 -- 172.21.15.16:0/732924724 shutdown_connections 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.356+0000 7fe6cb200640 1 --2- 172.21.15.16:0/732924724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b5640 0x7fe6cc13ff40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.356+0000 7fe6cb200640 1 -- 172.21.15.16:0/732924724 >> 172.21.15.16:0/732924724 conn(0x7fe6cc068270 msgr2=0x7fe6cc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:58.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.356+0000 7fe6cb200640 1 -- 172.21.15.16:0/732924724 shutdown_connections 2024-04-26T23:34:58.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.356+0000 7fe6cb200640 1 -- 172.21.15.16:0/732924724 wait complete. 2024-04-26T23:34:58.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.357+0000 7fe6cb200640 1 Processor -- start 2024-04-26T23:34:58.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.357+0000 7fe6cb200640 1 -- start start 2024-04-26T23:34:58.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6cb200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6cc0b5640 0x7fe6cc0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6cb200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b6940 0x7fe6cc1df940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6cb200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe6cc149ff0 0x7fe6cc1dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6cb200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc0b3710 con 0x7fe6cc0b6940 2024-04-26T23:34:58.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6cb200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc070680 con 0x7fe6cc0b5640 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6cb200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fe6cc0b3890 con 0x7fe6cc149ff0 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b6940 0x7fe6cc1df940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b6940 0x7fe6cc1df940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48898/0 (socket says 172.21.15.16:48898) 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.358+0000 7fe6c3e00640 1 -- 172.21.15.16:0/1431668470 learned_addr learned my addr 172.21.15.16:0/1431668470 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c3e00640 1 -- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe6cc149ff0 msgr2=0x7fe6cc1dc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c3e00640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe6cc149ff0 0x7fe6cc1dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c3e00640 1 -- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6cc0b5640 msgr2=0x7fe6cc0731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c3e00640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6cc0b5640 0x7fe6cc0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c3e00640 1 -- 172.21.15.16:0/1431668470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc1cf8f0 con 0x7fe6cc0b6940 2024-04-26T23:34:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c3e00640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b6940 0x7fe6cc1df940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4035040 tx=0x7fe6b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c2000640 1 -- 172.21.15.16:0/1431668470 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4037040 con 0x7fe6cc0b6940 2024-04-26T23:34:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c2000640 1 -- 172.21.15.16:0/1431668470 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b4030500 con 0x7fe6cc0b6940 2024-04-26T23:34:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.359+0000 7fe6c2000640 1 -- 172.21.15.16:0/1431668470 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4030910 con 0x7fe6cc0b6940 2024-04-26T23:34:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.360+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6cc073e50 con 0x7fe6cc0b6940 2024-04-26T23:34:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.360+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6cc1cf610 con 0x7fe6cc0b6940 2024-04-26T23:34:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.361+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6cc076600 con 0x7fe6cc0b6940 2024-04-26T23:34:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.362+0000 7fe6c2000640 1 -- 172.21.15.16:0/1431668470 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6b4044020 con 0x7fe6cc0b6940 2024-04-26T23:34:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.362+0000 7fe6c2000640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe6a806c8f0 0x7fe6a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.363+0000 7fe6c2000640 1 -- 172.21.15.16:0/1431668470 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe6b40abde0 con 0x7fe6cc0b6940 2024-04-26T23:34:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.363+0000 7fe6c9e00640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe6a806c8f0 0x7fe6a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.364+0000 7fe6c9e00640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe6a806c8f0 0x7fe6a806edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001610 tx=0x7fe6bc007930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.367+0000 7fe6c2000640 1 -- 172.21.15.16:0/1431668470 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe6cc1cf8f0 con 0x7fe6cc0b6940 2024-04-26T23:34:58.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.576+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe6cc14a5b0 con 0x7fe6cc0b6940 2024-04-26T23:34:58.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.577+0000 7fe6c2000640 1 -- 172.21.15.16:0/1431668470 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe6b407a200 con 0x7fe6cc0b6940 2024-04-26T23:34:58.580 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T23:34:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe6a806c8f0 msgr2=0x7fe6a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe6a806c8f0 0x7fe6a806edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001610 tx=0x7fe6bc007930 comp rx=0 tx=0).stop 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b6940 msgr2=0x7fe6cc1df940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b6940 0x7fe6cc1df940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4035040 tx=0x7fe6b40046c0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 shutdown_connections 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fe6a806c8f0 0x7fe6a806edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fe6cc149ff0 0x7fe6cc1dc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6cc0b6940 0x7fe6cc1df940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 --2- 172.21.15.16:0/1431668470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe6cc0b5640 0x7fe6cc0731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 >> 172.21.15.16:0/1431668470 conn(0x7fe6cc068270 msgr2=0x7fe6cc0b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 shutdown_connections 2024-04-26T23:34:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.580+0000 7fe6cb200640 1 -- 172.21.15.16:0/1431668470 wait complete. 2024-04-26T23:34:58.601 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:34:58.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.804+0000 7f8332e00640 1 Processor -- start 2024-04-26T23:34:58.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.804+0000 7f8332e00640 1 -- start start 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.805+0000 7f8332e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f832c06d770 0x7f832c0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.805+0000 7f8332e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c1450d0 0x7f832c145530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8332e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832c06db50 con 0x7f832c13eee0 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8332e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f832c0b2f50 con 0x7f832c06d770 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8332e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f832c0b2be0 con 0x7f832c1450d0 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8331a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f832c06d770 0x7f832c0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8332400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f832c13eee0 0x7f832c148640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41160/0 (socket says 172.21.15.16:41160) 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8332400640 1 -- 172.21.15.16:0/2789818435 learned_addr learned my addr 172.21.15.16:0/2789818435 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8331000640 1 --2- 172.21.15.16:0/2789818435 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c1450d0 0x7f832c145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8331a00640 1 -- 172.21.15.16:0/2789818435 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c1450d0 msgr2=0x7f832c145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:58.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8331a00640 1 --2- 172.21.15.16:0/2789818435 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c1450d0 0x7f832c145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8331a00640 1 -- 172.21.15.16:0/2789818435 >> v1:172.21.15.16:6789/0 conn(0x7f832c13eee0 legacy=0x7f832c148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.806+0000 7f8331a00640 1 -- 172.21.15.16:0/2789818435 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c0b2520 con 0x7f832c06d770 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.807+0000 7f8331a00640 1 --2- 172.21.15.16:0/2789818435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c06d770 0x7f832c0b5a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8320009d90 tx=0x7f832002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1123e7e057e06c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.808+0000 7f832be00640 1 -- 172.21.15.16:0/2789818435 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320031600 con 0x7f832c06d770 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.808+0000 7f832be00640 1 -- 172.21.15.16:0/2789818435 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83200317a0 con 0x7f832c06d770 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.808+0000 7f832be00640 1 -- 172.21.15.16:0/2789818435 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320031b70 con 0x7f832c06d770 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.808+0000 7f8332e00640 1 -- 172.21.15.16:0/2789818435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c06d770 msgr2=0x7f832c0b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.808+0000 7f8332e00640 1 --2- 172.21.15.16:0/2789818435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c06d770 0x7f832c0b5a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8320009d90 tx=0x7f832002a5d0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.809+0000 7f8332e00640 1 -- 172.21.15.16:0/2789818435 shutdown_connections 2024-04-26T23:34:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.809+0000 7f8332e00640 1 --2- 172.21.15.16:0/2789818435 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c1450d0 0x7f832c145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.809+0000 7f8332e00640 1 --2- 172.21.15.16:0/2789818435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c06d770 0x7f832c0b5a60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.809+0000 7f8332e00640 1 -- 172.21.15.16:0/2789818435 >> 172.21.15.16:0/2789818435 conn(0x7f832c0b9db0 msgr2=0x7f832c0ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.809+0000 7f8332e00640 1 -- 172.21.15.16:0/2789818435 shutdown_connections 2024-04-26T23:34:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.809+0000 7f8332e00640 1 -- 172.21.15.16:0/2789818435 wait complete. 2024-04-26T23:34:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.810+0000 7f8332e00640 1 Processor -- start 2024-04-26T23:34:58.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.811+0000 7f8332e00640 1 -- start start 2024-04-26T23:34:58.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.811+0000 7f8332e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c06d770 0x7f832c071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.811+0000 7f8332e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c13eee0 0x7f832c1db990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.811+0000 7f8332e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f832c1450d0 0x7f832c1d5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.811+0000 7f8332e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f832c0b6120 con 0x7f832c13eee0 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.811+0000 7f8332e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f832c0b5fa0 con 0x7f832c1450d0 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.811+0000 7f8332e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f832c13f370 con 0x7f832c06d770 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c13eee0 0x7f832c1db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c13eee0 0x7f832c1db990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48914/0 (socket says 172.21.15.16:48914) 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 -- 172.21.15.16:0/4150243478 learned_addr learned my addr 172.21.15.16:0/4150243478 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331a00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c06d770 0x7f832c071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8332400640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f832c1450d0 0x7f832c1d5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 -- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c06d770 msgr2=0x7f832c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c06d770 0x7f832c071c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 -- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f832c1450d0 msgr2=0x7f832c1d5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:58.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f832c1450d0 0x7f832c1d5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:58.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.812+0000 7f8331000640 1 -- 172.21.15.16:0/4150243478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c139600 con 0x7f832c13eee0 2024-04-26T23:34:58.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.813+0000 7f8331000640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c13eee0 0x7f832c1db990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f831800d620 tx=0x7f831800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:58.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.813+0000 7f8329600640 1 -- 172.21.15.16:0/4150243478 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831800b620 con 0x7f832c13eee0 2024-04-26T23:34:58.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.813+0000 7f8329600640 1 -- 172.21.15.16:0/4150243478 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8318019070 con 0x7f832c13eee0 2024-04-26T23:34:58.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.813+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832c071880 con 0x7f832c13eee0 2024-04-26T23:34:58.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.813+0000 7f8329600640 1 -- 172.21.15.16:0/4150243478 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831800ba00 con 0x7f832c13eee0 2024-04-26T23:34:58.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.813+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832c0721b0 con 0x7f832c13eee0 2024-04-26T23:34:58.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.814+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f832c076600 con 0x7f832c13eee0 2024-04-26T23:34:58.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.815+0000 7f8329600640 1 -- 172.21.15.16:0/4150243478 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f831800bba0 con 0x7f832c13eee0 2024-04-26T23:34:58.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.816+0000 7f8329600640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f830c06c8f0 0x7f830c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:58.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.816+0000 7f8329600640 1 -- 172.21.15.16:0/4150243478 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f831808bf50 con 0x7f832c13eee0 2024-04-26T23:34:58.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.817+0000 7f8331a00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f830c06c8f0 0x7f830c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:58.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.818+0000 7f8331a00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f830c06c8f0 0x7f830c06edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8320034000 tx=0x7f832002f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:58.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:58.821+0000 7f8329600640 1 -- 172.21.15.16:0/4150243478 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f831805a370 con 0x7f832c13eee0 2024-04-26T23:34:59.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.029+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f832c1436a0 con 0x7f832c13eee0 2024-04-26T23:34:59.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.030+0000 7f8329600640 1 -- 172.21.15.16:0/4150243478 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f8318060030 con 0x7f832c13eee0 2024-04-26T23:34:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f830c06c8f0 msgr2=0x7f830c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f830c06c8f0 0x7f830c06edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8320034000 tx=0x7f832002f000 comp rx=0 tx=0).stop 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c13eee0 msgr2=0x7f832c1db990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c13eee0 0x7f832c1db990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f831800d620 tx=0x7f831800dae0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 shutdown_connections 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f830c06c8f0 0x7f830c06edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f832c1450d0 0x7f832c1d5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f832c13eee0 0x7f832c1db990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 --2- 172.21.15.16:0/4150243478 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f832c06d770 0x7f832c071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 >> 172.21.15.16:0/4150243478 conn(0x7f832c0b9db0 msgr2=0x7f832c0b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:59.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 shutdown_connections 2024-04-26T23:34:59.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.033+0000 7f8332e00640 1 -- 172.21.15.16:0/4150243478 wait complete. 2024-04-26T23:34:59.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:34:59.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.265+0000 7fd1ffe00640 1 Processor -- start 2024-04-26T23:34:59.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.265+0000 7fd1ffe00640 1 -- start start 2024-04-26T23:34:59.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.267+0000 7fd1ffe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd2000701e0 0x7fd200151a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.267+0000 7fd1ffe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2000b6e70 con 0x7fd2000b6a90 2024-04-26T23:34:59.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.267+0000 7fd1ffe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2000b39a0 con 0x7fd200073600 2024-04-26T23:34:59.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.267+0000 7fd1ffe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd2000b3cf0 con 0x7fd2000701e0 2024-04-26T23:34:59.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.267+0000 7fd1fea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd2000b6a90 0x7fd200072ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41172/0 (socket says 172.21.15.16:41172) 2024-04-26T23:34:59.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.267+0000 7fd1fea00640 1 -- 172.21.15.16:0/2078188073 learned_addr learned my addr 172.21.15.16:0/2078188073 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:34:59.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.267+0000 7fd1ff400640 1 --2- 172.21.15.16:0/2078188073 >> v2:172.21.15.16:3300/0 conn(0x7fd2000701e0 0x7fd200151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.268+0000 7fd1fe000640 1 -- 172.21.15.16:0/2078188073 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505717383 0 0) 0x7fd2000b6e70 con 0x7fd2000b6a90 2024-04-26T23:34:59.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.268+0000 7fd1fe000640 1 -- 172.21.15.16:0/2078188073 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e4003520 con 0x7fd2000b6a90 2024-04-26T23:34:59.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.268+0000 7fd1ff400640 1 -- 172.21.15.16:0/2078188073 >> v1:172.21.15.32:6789/0 conn(0x7fd200073600 legacy=0x7fd2001461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:59.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.268+0000 7fd1ff400640 1 -- 172.21.15.16:0/2078188073 >> v1:172.21.15.16:6789/0 conn(0x7fd2000b6a90 legacy=0x7fd200072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.268+0000 7fd1ff400640 1 -- 172.21.15.16:0/2078188073 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd200073ca0 con 0x7fd2000701e0 2024-04-26T23:34:59.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.269+0000 7fd1ff400640 1 --2- 172.21.15.16:0/2078188073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000701e0 0x7fd200151a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d90 tx=0x7fd1f802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3041d0f120f26d76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:59.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.269+0000 7fd1fe000640 1 -- 172.21.15.16:0/2078188073 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007740 con 0x7fd2000701e0 2024-04-26T23:34:59.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.269+0000 7fd1fe000640 1 -- 172.21.15.16:0/2078188073 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f80078e0 con 0x7fd2000701e0 2024-04-26T23:34:59.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.269+0000 7fd1fe000640 1 -- 172.21.15.16:0/2078188073 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007c90 con 0x7fd2000701e0 2024-04-26T23:34:59.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.270+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2078188073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000701e0 msgr2=0x7fd200151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.270+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2078188073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000701e0 0x7fd200151a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d90 tx=0x7fd1f802a580 comp rx=0 tx=0).stop 2024-04-26T23:34:59.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.270+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2078188073 shutdown_connections 2024-04-26T23:34:59.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.270+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2078188073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000701e0 0x7fd200151a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.270+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2078188073 >> 172.21.15.16:0/2078188073 conn(0x7fd200068270 msgr2=0x7fd200068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:59.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.270+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2078188073 shutdown_connections 2024-04-26T23:34:59.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.270+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2078188073 wait complete. 2024-04-26T23:34:59.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.271+0000 7fd1ffe00640 1 Processor -- start 2024-04-26T23:34:59.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.272+0000 7fd1ffe00640 1 -- start start 2024-04-26T23:34:59.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.272+0000 7fd1ffe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2000701e0 0x7fd200141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.272+0000 7fd1ffe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd200073600 0x7fd2000ba340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.272+0000 7fd1ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000b6a90 0x7fd20013df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.272+0000 7fd1ffe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000714b0 con 0x7fd2000b6a90 2024-04-26T23:34:59.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.272+0000 7fd1ffe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fd200146ae0 con 0x7fd2000701e0 2024-04-26T23:34:59.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.272+0000 7fd1ffe00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fd200070770 con 0x7fd200073600 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000b6a90 0x7fd20013df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000b6a90 0x7fd20013df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48924/0 (socket says 172.21.15.16:48924) 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 -- 172.21.15.16:0/2745613759 learned_addr learned my addr 172.21.15.16:0/2745613759 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1fea00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2000701e0 0x7fd200141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1f6000640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd200073600 0x7fd2000ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 -- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd200073600 msgr2=0x7fd2000ba340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd200073600 0x7fd2000ba340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 -- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2000701e0 msgr2=0x7fd200141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2000701e0 0x7fd200141df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.273+0000 7fd1ff400640 1 -- 172.21.15.16:0/2745613759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2000b9720 con 0x7fd2000b6a90 2024-04-26T23:34:59.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.274+0000 7fd1ff400640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000b6a90 0x7fd20013df90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009eb0 tx=0x7fd1f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:59.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.274+0000 7fd1f7400640 1 -- 172.21.15.16:0/2745613759 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8040070 con 0x7fd2000b6a90 2024-04-26T23:34:59.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.274+0000 7fd1f7400640 1 -- 172.21.15.16:0/2745613759 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f8031bc0 con 0x7fd2000b6a90 2024-04-26T23:34:59.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.274+0000 7fd1f7400640 1 -- 172.21.15.16:0/2745613759 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8009450 con 0x7fd2000b6a90 2024-04-26T23:34:59.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.274+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2000b9e20 con 0x7fd2000b6a90 2024-04-26T23:34:59.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.274+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2000b8710 con 0x7fd2000b6a90 2024-04-26T23:34:59.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.275+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd200076600 con 0x7fd2000b6a90 2024-04-26T23:34:59.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.276+0000 7fd1f7400640 1 -- 172.21.15.16:0/2745613759 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1f8039040 con 0x7fd2000b6a90 2024-04-26T23:34:59.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.277+0000 7fd1f7400640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1dc06c920 0x7fd1dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.277+0000 7fd1f7400640 1 -- 172.21.15.16:0/2745613759 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f80acfb0 con 0x7fd2000b6a90 2024-04-26T23:34:59.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.278+0000 7fd1fea00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1dc06c920 0x7fd1dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.279+0000 7fd1fea00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1dc06c920 0x7fd1dc06ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0005880 tx=0x7fd1f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:59.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.282+0000 7fd1f7400640 1 -- 172.21.15.16:0/2745613759 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd1f807ae20 con 0x7fd2000b6a90 2024-04-26T23:34:59.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.532+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd200145940 con 0x7fd2000b6a90 2024-04-26T23:34:59.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.533+0000 7fd1f7400640 1 -- 172.21.15.16:0/2745613759 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fd1f807f120 con 0x7fd2000b6a90 2024-04-26T23:34:59.537 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:59.537 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:34:45.529018+0000","modified":"2024-04-26T23:34:48.591854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1571792382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1571792382},{"type":"v1","addr":"172.21.15.32:6835","nonce":1571792382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-26T23:34:59.537 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-26T23:34:59.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1dc06c920 msgr2=0x7fd1dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1dc06c920 0x7fd1dc06ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0005880 tx=0x7fd1f0009040 comp rx=0 tx=0).stop 2024-04-26T23:34:59.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000b6a90 msgr2=0x7fd20013df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000b6a90 0x7fd20013df90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009eb0 tx=0x7fd1f8004a40 comp rx=0 tx=0).stop 2024-04-26T23:34:59.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 shutdown_connections 2024-04-26T23:34:59.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd1dc06c920 0x7fd1dc06ede0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2000b6a90 0x7fd20013df90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd200073600 0x7fd2000ba340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 --2- 172.21.15.16:0/2745613759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2000701e0 0x7fd200141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.536+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 >> 172.21.15.16:0/2745613759 conn(0x7fd200068270 msgr2=0x7fd2001d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.537+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 shutdown_connections 2024-04-26T23:34:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.537+0000 7fd1ffe00640 1 -- 172.21.15.16:0/2745613759 wait complete. 2024-04-26T23:34:59.560 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:34:59.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.764+0000 7f4dbf200640 1 Processor -- start 2024-04-26T23:34:59.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.764+0000 7f4dbf200640 1 -- start start 2024-04-26T23:34:59.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbf200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4dc00bbc30 0x7f4dc0148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbf200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4dc0073420 0x7f4dc0073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbf200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc00bc010 con 0x7f4dc00bd7a0 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbf200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc0149220 con 0x7f4dc0073420 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbf200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc0148220 con 0x7f4dc00bbc30 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbe800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4dc0073420 0x7f4dc0073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbe800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4dc0073420 0x7f4dc0073cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48938/0 (socket says 172.21.15.16:48938) 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.765+0000 7f4dbe800640 1 -- 172.21.15.16:0/2159189514 learned_addr learned my addr 172.21.15.16:0/2159189514 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.766+0000 7f4dbde00640 1 --2- 172.21.15.16:0/2159189514 >> v2:172.21.15.32:3300/0 conn(0x7f4dc00bbc30 0x7f4dc0148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.766+0000 7f4dbe800640 1 -- 172.21.15.16:0/2159189514 >> v2:172.21.15.32:3300/0 conn(0x7f4dc00bbc30 msgr2=0x7f4dc0148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.766+0000 7f4dbe800640 1 --2- 172.21.15.16:0/2159189514 >> v2:172.21.15.32:3300/0 conn(0x7f4dc00bbc30 0x7f4dc0148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.766+0000 7f4dbe800640 1 -- 172.21.15.16:0/2159189514 >> v1:172.21.15.32:6789/0 conn(0x7f4dc00bd7a0 legacy=0x7f4dc00baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.766+0000 7f4dbe800640 1 -- 172.21.15.16:0/2159189514 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc01484e0 con 0x7f4dc0073420 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.767+0000 7f4dbe800640 1 --2- 172.21.15.16:0/2159189514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc0073cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00bb470 tx=0x7f4db802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43d0c19b6da481f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.767+0000 7f4dbca00640 1 -- 172.21.15.16:0/2159189514 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8037070 con 0x7f4dc0073420 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.767+0000 7f4dbca00640 1 -- 172.21.15.16:0/2159189514 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db8032440 con 0x7f4dc0073420 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.767+0000 7f4dbca00640 1 -- 172.21.15.16:0/2159189514 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8032810 con 0x7f4dc0073420 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 -- 172.21.15.16:0/2159189514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 msgr2=0x7f4dc0073cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 --2- 172.21.15.16:0/2159189514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc0073cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00bb470 tx=0x7f4db802a150 comp rx=0 tx=0).stop 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 -- 172.21.15.16:0/2159189514 shutdown_connections 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 --2- 172.21.15.16:0/2159189514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc0073cf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 --2- 172.21.15.16:0/2159189514 >> v2:172.21.15.32:3300/0 conn(0x7f4dc00bbc30 0x7f4dc0148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 -- 172.21.15.16:0/2159189514 >> 172.21.15.16:0/2159189514 conn(0x7f4dc009fc60 msgr2=0x7f4dc00a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:59.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 -- 172.21.15.16:0/2159189514 shutdown_connections 2024-04-26T23:34:59.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.768+0000 7f4dbf200640 1 -- 172.21.15.16:0/2159189514 wait complete. 2024-04-26T23:34:59.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.770+0000 7f4dbf200640 1 Processor -- start 2024-04-26T23:34:59.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.770+0000 7f4dbf200640 1 -- start start 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc00bbc30 0x7f4dc01e13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4dc00bd7a0 0x7f4dc0141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbf200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc00743b0 con 0x7f4dc0073420 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbf200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0074230 con 0x7f4dc00bbc30 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbf200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc0074530 con 0x7f4dc00bd7a0 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc014b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48954/0 (socket says 172.21.15.16:48954) 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.771+0000 7f4dbde00640 1 -- 172.21.15.16:0/1825477035 learned_addr learned my addr 172.21.15.16:0/1825477035 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbe800640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4dc00bd7a0 0x7f4dc0141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbde00640 1 -- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4dc00bd7a0 msgr2=0x7f4dc0141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbde00640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4dc00bd7a0 0x7f4dc0141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbde00640 1 -- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc00bbc30 msgr2=0x7f4dc01e13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbde00640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc00bbc30 0x7f4dc01e13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbde00640 1 -- 172.21.15.16:0/1825477035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc01d44f0 con 0x7f4dc0073420 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbde00640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc014b600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4db000d800 tx=0x7f4db000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4db6000640 1 -- 172.21.15.16:0/1825477035 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db000b6c0 con 0x7f4dc0073420 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4db6000640 1 -- 172.21.15.16:0/1825477035 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db0019070 con 0x7f4dc0073420 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc0144080 con 0x7f4dc0073420 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4db6000640 1 -- 172.21.15.16:0/1825477035 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db000bac0 con 0x7f4dc0073420 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.772+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc0142df0 con 0x7f4dc0073420 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.773+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc0076600 con 0x7f4dc0073420 2024-04-26T23:34:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.774+0000 7f4db6000640 1 -- 172.21.15.16:0/1825477035 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4db000bc60 con 0x7f4dc0073420 2024-04-26T23:34:59.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.776+0000 7f4db6000640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:34:59.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.776+0000 7f4db6000640 1 -- 172.21.15.16:0/1825477035 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4db008bfd0 con 0x7f4dc0073420 2024-04-26T23:34:59.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.776+0000 7f4dbd400640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:34:59.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.777+0000 7f4dbd400640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4dc014bda0 tx=0x7f4da8007cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:34:59.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.780+0000 7f4db6000640 1 -- 172.21.15.16:0/1825477035 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4db005a490 con 0x7f4dc0073420 2024-04-26T23:34:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.985+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dc0142ff0 con 0x7f4dc0073420 2024-04-26T23:34:59.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.988+0000 7f4db6000640 1 -- 172.21.15.16:0/1825477035 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16561 (secure 0 0 0) 0x7f4db0059d90 con 0x7f4dc0073420 2024-04-26T23:34:59.992 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:34:59.992 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:47.057746+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4d9c06c8f0 msgr2=0x7f4d9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4dc014bda0 tx=0x7f4da8007cf0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 msgr2=0x7f4dc014b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc014b600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4db000d800 tx=0x7f4db000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 shutdown_connections 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc00bbc30 0x7f4dc01e13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4dc00bd7a0 0x7f4dc0141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 --2- 172.21.15.16:0/1825477035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dc0073420 0x7f4dc014b600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:34:59.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.990+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 >> 172.21.15.16:0/1825477035 conn(0x7f4dc009fc60 msgr2=0x7f4dc00b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:34:59.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.991+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 shutdown_connections 2024-04-26T23:34:59.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:34:59.991+0000 7f4dbf200640 1 -- 172.21.15.16:0/1825477035 wait complete. 2024-04-26T23:35:00.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:34:39.843396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:34:43.895977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:34:44.517438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:35:00.015 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:35:00.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.229+0000 7f784d800640 1 Processor -- start 2024-04-26T23:35:00.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.229+0000 7f784d800640 1 -- start start 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f784d800640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f78480b6940 0x7f78481498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f784d800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78480b5640 0x7f7848149e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f784d800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78480718e0 con 0x7f784813ff40 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f784d800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f78480b3af0 con 0x7f78480b5640 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f784d800640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f7848070680 con 0x7f78480b6940 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f7847400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78480b5640 0x7f7848149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f784ce00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f784813ff40 0x7f7848140350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41178/0 (socket says 172.21.15.16:41178) 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f784ce00640 1 -- 172.21.15.16:0/2567362680 learned_addr learned my addr 172.21.15.16:0/2567362680 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.231+0000 7f7847e00640 1 --2- 172.21.15.16:0/2567362680 >> v2:172.21.15.32:3300/0 conn(0x7f78480b6940 0x7f78481498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.232+0000 7f7847400640 1 -- 172.21.15.16:0/2567362680 >> v2:172.21.15.32:3300/0 conn(0x7f78480b6940 msgr2=0x7f78481498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.232+0000 7f7847400640 1 --2- 172.21.15.16:0/2567362680 >> v2:172.21.15.32:3300/0 conn(0x7f78480b6940 0x7f78481498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.232+0000 7f7847400640 1 -- 172.21.15.16:0/2567362680 >> v1:172.21.15.16:6789/0 conn(0x7f784813ff40 legacy=0x7f7848140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.232+0000 7f7847400640 1 -- 172.21.15.16:0/2567362680 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78480b6d20 con 0x7f78480b5640 2024-04-26T23:35:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.233+0000 7f7847400640 1 --2- 172.21.15.16:0/2567362680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78480b5640 0x7f7848149e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78480b7270 tx=0x7f783402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6debcd13705465d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.233+0000 7f7846a00640 1 -- 172.21.15.16:0/2567362680 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834037070 con 0x7f78480b5640 2024-04-26T23:35:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.233+0000 7f7846a00640 1 -- 172.21.15.16:0/2567362680 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834032440 con 0x7f78480b5640 2024-04-26T23:35:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.233+0000 7f7846a00640 1 -- 172.21.15.16:0/2567362680 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783402ae60 con 0x7f78480b5640 2024-04-26T23:35:00.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 -- 172.21.15.16:0/2567362680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78480b5640 msgr2=0x7f7848149e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 --2- 172.21.15.16:0/2567362680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78480b5640 0x7f7848149e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78480b7270 tx=0x7f783402a110 comp rx=0 tx=0).stop 2024-04-26T23:35:00.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 -- 172.21.15.16:0/2567362680 shutdown_connections 2024-04-26T23:35:00.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 --2- 172.21.15.16:0/2567362680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78480b5640 0x7f7848149e20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 --2- 172.21.15.16:0/2567362680 >> v2:172.21.15.32:3300/0 conn(0x7f78480b6940 0x7f78481498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 -- 172.21.15.16:0/2567362680 >> 172.21.15.16:0/2567362680 conn(0x7f7848068270 msgr2=0x7f7848068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:00.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 -- 172.21.15.16:0/2567362680 shutdown_connections 2024-04-26T23:35:00.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.234+0000 7f784d800640 1 -- 172.21.15.16:0/2567362680 wait complete. 2024-04-26T23:35:00.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.236+0000 7f784d800640 1 Processor -- start 2024-04-26T23:35:00.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.236+0000 7f784d800640 1 -- start start 2024-04-26T23:35:00.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78480b5640 0x7f7848072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784d800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f78480b6940 0x7f78481dc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f784813ff40 0x7f78481dc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f78480b3710 con 0x7f784813ff40 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f78480b3d10 con 0x7f78480b5640 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784d800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f78480b3890 con 0x7f78480b6940 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f784813ff40 0x7f78481dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f784813ff40 0x7f78481dc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48976/0 (socket says 172.21.15.16:48976) 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784ce00640 1 -- 172.21.15.16:0/1029228912 learned_addr learned my addr 172.21.15.16:0/1029228912 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f7847400640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f78480b6940 0x7f78481dc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f7847e00640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78480b5640 0x7f7848072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784ce00640 1 -- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f78480b6940 msgr2=0x7f78481dc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784ce00640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f78480b6940 0x7f78481dc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784ce00640 1 -- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78480b5640 msgr2=0x7f7848072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.237+0000 7f784ce00640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78480b5640 0x7f7848072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.238+0000 7f784ce00640 1 -- 172.21.15.16:0/1029228912 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78481d0710 con 0x7f784813ff40 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.238+0000 7f784ce00640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f784813ff40 0x7f78481dc540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f784000ca80 tx=0x7f784000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.238+0000 7f783fe00640 1 -- 172.21.15.16:0/1029228912 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840017070 con 0x7f784813ff40 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.238+0000 7f783fe00640 1 -- 172.21.15.16:0/1029228912 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784000abd0 con 0x7f784813ff40 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.238+0000 7f783fe00640 1 -- 172.21.15.16:0/1029228912 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840012400 con 0x7f784813ff40 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.238+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7848142300 con 0x7f784813ff40 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.238+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7848142df0 con 0x7f784813ff40 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.239+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78480b70e0 con 0x7f784813ff40 2024-04-26T23:35:00.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.240+0000 7f783fe00640 1 -- 172.21.15.16:0/1029228912 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f784001a070 con 0x7f784813ff40 2024-04-26T23:35:00.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.241+0000 7f783fe00640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f782806c8f0 0x7f782806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.241+0000 7f783fe00640 1 -- 172.21.15.16:0/1029228912 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f784008b6e0 con 0x7f784813ff40 2024-04-26T23:35:00.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.242+0000 7f7847e00640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f782806c8f0 0x7f782806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.243+0000 7f7847e00640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f782806c8f0 0x7f782806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7838006fd0 tx=0x7f7838008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:00.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.246+0000 7f783fe00640 1 -- 172.21.15.16:0/1029228912 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f78480b70e0 con 0x7f784813ff40 2024-04-26T23:35:00.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.451+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7848076600 con 0x7f784813ff40 2024-04-26T23:35:00.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.451+0000 7f783fe00640 1 -- 172.21.15.16:0/1029228912 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f78400594b0 con 0x7f784813ff40 2024-04-26T23:35:00.455 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T23:35:00.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f782806c8f0 msgr2=0x7f782806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f782806c8f0 0x7f782806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7838006fd0 tx=0x7f7838008040 comp rx=0 tx=0).stop 2024-04-26T23:35:00.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f784813ff40 msgr2=0x7f78481dc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f784813ff40 0x7f78481dc540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f784000ca80 tx=0x7f784000cf40 comp rx=0 tx=0).stop 2024-04-26T23:35:00.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 shutdown_connections 2024-04-26T23:35:00.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f782806c8f0 0x7f782806edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f784813ff40 0x7f78481dc540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f78480b6940 0x7f78481dc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 --2- 172.21.15.16:0/1029228912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78480b5640 0x7f7848072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.454+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 >> 172.21.15.16:0/1029228912 conn(0x7f7848068270 msgr2=0x7f78480b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.455+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 shutdown_connections 2024-04-26T23:35:00.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.455+0000 7f784d800640 1 -- 172.21.15.16:0/1029228912 wait complete. 2024-04-26T23:35:00.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:35:00.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.683+0000 7f4079200640 1 Processor -- start 2024-04-26T23:35:00.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.683+0000 7f4079200640 1 -- start start 2024-04-26T23:35:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.684+0000 7f4079200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f40740b5640 0x7f407413ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.684+0000 7f4079200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 0x7f4074140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.684+0000 7f4079200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40740718e0 con 0x7f40740b6940 2024-04-26T23:35:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.684+0000 7f4079200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f40740b3af0 con 0x7f40740b5640 2024-04-26T23:35:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.684+0000 7f4079200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f4074070680 con 0x7f4074149ff0 2024-04-26T23:35:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.685+0000 7f4073400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f40740b6940 0x7f40741498e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41190/0 (socket says 172.21.15.16:41190) 2024-04-26T23:35:00.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.685+0000 7f4073400640 1 -- 172.21.15.16:0/3477708473 learned_addr learned my addr 172.21.15.16:0/3477708473 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.685+0000 7f4073e00640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 0x7f4074140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.685+0000 7f4072a00640 1 --2- 172.21.15.16:0/3477708473 >> v2:172.21.15.32:3300/0 conn(0x7f40740b5640 0x7f407413ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.685+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165018317 0 0) 0x7f40740718e0 con 0x7f40740b6940 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.685+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4058003520 con 0x7f40740b6940 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 210261210 0 0) 0x7f4058003520 con 0x7f40740b6940 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 msgr2=0x7f4074140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 0x7f4074140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 >> v2:172.21.15.32:3300/0 conn(0x7f40740b5640 msgr2=0x7f407413ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 --2- 172.21.15.16:0/3477708473 >> v2:172.21.15.32:3300/0 conn(0x7f40740b5640 0x7f407413ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40740b6d20 con 0x7f40740b6940 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f4064001690 con 0x7f40740b6940 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 >> v1:172.21.15.16:6789/0 conn(0x7f40740b6940 legacy=0x7f40741498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40580039b0 0x7f4058003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4058004800 0x7f4058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 0x7f40580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40740b3af0 con 0x7f4058004800 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f4074070680 con 0x7f40580039b0 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f405800b9c0 con 0x7f4074149ff0 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072a00640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4058004800 0x7f4058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4073e00640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 0x7f40580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072a00640 1 -- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 msgr2=0x7f40580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.686+0000 7f4072a00640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4074149ff0 0x7f40580051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.687+0000 7f4072a00640 1 -- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40580039b0 msgr2=0x7f4058003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:00.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.687+0000 7f4072a00640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f40580039b0 0x7f4058003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.687+0000 7f4072a00640 1 -- 172.21.15.16:0/3477708473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4058003520 con 0x7f4058004800 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.688+0000 7f4072a00640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4058004800 0x7f4058004c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4060009af0 tx=0x7f4058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be7998e3486bd61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.688+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060036070 con 0x7f4058004800 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.688+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4060031400 con 0x7f4058004800 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.688+0000 7f4072000640 1 -- 172.21.15.16:0/3477708473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060009690 con 0x7f4058004800 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.688+0000 7f4079200640 1 -- 172.21.15.16:0/3477708473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4058004800 msgr2=0x7f4058004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.688+0000 7f4079200640 1 --2- 172.21.15.16:0/3477708473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4058004800 0x7f4058004c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4060009af0 tx=0x7f4058005830 comp rx=0 tx=0).stop 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.688+0000 7f4073e00640 1 -- 172.21.15.16:0/3477708473 reap_dead start 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.689+0000 7f4079200640 1 -- 172.21.15.16:0/3477708473 shutdown_connections 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.689+0000 7f4079200640 1 -- 172.21.15.16:0/3477708473 >> 172.21.15.16:0/3477708473 conn(0x7f4074068270 msgr2=0x7f4074068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.689+0000 7f4079200640 1 -- 172.21.15.16:0/3477708473 shutdown_connections 2024-04-26T23:35:00.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.689+0000 7f4079200640 1 -- 172.21.15.16:0/3477708473 wait complete. 2024-04-26T23:35:00.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.690+0000 7f4079200640 1 Processor -- start 2024-04-26T23:35:00.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.690+0000 7f4079200640 1 -- start start 2024-04-26T23:35:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.691+0000 7f4079200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4058004800 0x7f40740b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.691+0000 7f4079200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40740ba500 0x7f40741e1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.691+0000 7f4079200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40741e16d0 0x7f407413c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.691+0000 7f4079200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40740b3710 con 0x7f40740ba500 2024-04-26T23:35:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.691+0000 7f4079200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f40740b3d10 con 0x7f4058004800 2024-04-26T23:35:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.691+0000 7f4079200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f40740b3890 con 0x7f40741e16d0 2024-04-26T23:35:00.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40740ba500 0x7f40741e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40740ba500 0x7f40741e1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48996/0 (socket says 172.21.15.16:48996) 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 -- 172.21.15.16:0/326153069 learned_addr learned my addr 172.21.15.16:0/326153069 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4073400640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4058004800 0x7f40740b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4073e00640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40741e16d0 0x7f407413c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 -- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40741e16d0 msgr2=0x7f407413c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40741e16d0 0x7f407413c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 -- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4058004800 msgr2=0x7f40740b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4058004800 0x7f40740b98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 -- 172.21.15.16:0/326153069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4074140b30 con 0x7f40740ba500 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.692+0000 7f4072a00640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40740ba500 0x7f40741e1190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4060009af0 tx=0x7f4060004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.693+0000 7f406b400640 1 -- 172.21.15.16:0/326153069 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060036070 con 0x7f40740ba500 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.693+0000 7f406b400640 1 -- 172.21.15.16:0/326153069 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4060041070 con 0x7f40740ba500 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.693+0000 7f406b400640 1 -- 172.21.15.16:0/326153069 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060003e40 con 0x7f40740ba500 2024-04-26T23:35:00.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.693+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40740b8ae0 con 0x7f40740ba500 2024-04-26T23:35:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.693+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40741e1b50 con 0x7f40740ba500 2024-04-26T23:35:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.694+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4074076600 con 0x7f40740ba500 2024-04-26T23:35:00.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.695+0000 7f406b400640 1 -- 172.21.15.16:0/326153069 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4060046460 con 0x7f40740ba500 2024-04-26T23:35:00.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.696+0000 7f406b400640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f405406c8f0 0x7f405406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:00.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.696+0000 7f406b400640 1 -- 172.21.15.16:0/326153069 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f40600abdc0 con 0x7f40740ba500 2024-04-26T23:35:00.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.697+0000 7f4073400640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f405406c8f0 0x7f405406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:00.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.698+0000 7f4073400640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f405406c8f0 0x7f405406edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4064000f60 tx=0x7f40640016a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:00.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.701+0000 7f406b400640 1 -- 172.21.15.16:0/326153069 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f406004b020 con 0x7f40740ba500 2024-04-26T23:35:00.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.906+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4074143df0 con 0x7f40740ba500 2024-04-26T23:35:00.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.906+0000 7f406b400640 1 -- 172.21.15.16:0/326153069 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f406007a1f0 con 0x7f40740ba500 2024-04-26T23:35:00.910 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T23:35:00.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.909+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f405406c8f0 msgr2=0x7f405406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.909+0000 7f4079200640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f405406c8f0 0x7f405406edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4064000f60 tx=0x7f40640016a0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.909+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40740ba500 msgr2=0x7f40741e1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.909+0000 7f4079200640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40740ba500 0x7f40741e1190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4060009af0 tx=0x7f4060004730 comp rx=0 tx=0).stop 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 shutdown_connections 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f405406c8f0 0x7f405406edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f40741e16d0 0x7f407413c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40740ba500 0x7f40741e1190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 --2- 172.21.15.16:0/326153069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4058004800 0x7f40740b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 >> 172.21.15.16:0/326153069 conn(0x7f4074068270 msgr2=0x7f407413e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 shutdown_connections 2024-04-26T23:35:00.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:00.910+0000 7f4079200640 1 -- 172.21.15.16:0/326153069 wait complete. 2024-04-26T23:35:00.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:35:01.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.131+0000 7fc8c4a00640 1 Processor -- start 2024-04-26T23:35:01.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.131+0000 7fc8c4a00640 1 -- start start 2024-04-26T23:35:01.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.132+0000 7fc8c4a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8c01424d0 0x7fc8c0072ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.132+0000 7fc8c4a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c0068090 0x7fc8c014bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.132+0000 7fc8c4a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8c0068510 0x7fc8c014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.132+0000 7fc8c4a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c0072530 con 0x7fc8c01424d0 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.132+0000 7fc8c4a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c01428b0 con 0x7fc8c0068510 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.132+0000 7fc8c4a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c00737a0 con 0x7fc8c0068090 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8c01424d0 0x7fc8c0072ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8c01424d0 0x7fc8c0072ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49000/0 (socket says 172.21.15.16:49000) 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 -- 172.21.15.16:0/4115684872 learned_addr learned my addr 172.21.15.16:0/4115684872 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8b5400640 1 --2- 172.21.15.16:0/4115684872 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c0068090 0x7fc8c014bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8be800640 1 --2- 172.21.15.16:0/4115684872 >> v2:172.21.15.32:3300/0 conn(0x7fc8c0068510 0x7fc8c014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 -- 172.21.15.16:0/4115684872 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c0068090 msgr2=0x7fc8c014bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 --2- 172.21.15.16:0/4115684872 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c0068090 0x7fc8c014bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 -- 172.21.15.16:0/4115684872 >> v2:172.21.15.32:3300/0 conn(0x7fc8c0068510 msgr2=0x7fc8c014c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 --2- 172.21.15.16:0/4115684872 >> v2:172.21.15.32:3300/0 conn(0x7fc8c0068510 0x7fc8c014c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8bde00640 1 -- 172.21.15.16:0/4115684872 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c0072810 con 0x7fc8c01424d0 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.133+0000 7fc8b5400640 1 --2- 172.21.15.16:0/4115684872 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c0068090 0x7fc8c014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:01.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.134+0000 7fc8bde00640 1 --2- 172.21.15.16:0/4115684872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c01424d0 0x7fc8c0072ca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0071f00 tx=0x7fc8b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f216625b7248d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.135+0000 7fc8bd400640 1 -- 172.21.15.16:0/4115684872 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0037070 con 0x7fc8c01424d0 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.135+0000 7fc8bd400640 1 -- 172.21.15.16:0/4115684872 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0032440 con 0x7fc8c01424d0 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.135+0000 7fc8bd400640 1 -- 172.21.15.16:0/4115684872 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0032810 con 0x7fc8c01424d0 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.135+0000 7fc8c4a00640 1 -- 172.21.15.16:0/4115684872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c01424d0 msgr2=0x7fc8c0072ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.135+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/4115684872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c01424d0 0x7fc8c0072ca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0071f00 tx=0x7fc8b002a180 comp rx=0 tx=0).stop 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.136+0000 7fc8c4a00640 1 -- 172.21.15.16:0/4115684872 shutdown_connections 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.136+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/4115684872 >> v2:172.21.15.32:3300/0 conn(0x7fc8c0068510 0x7fc8c014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.136+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/4115684872 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c0068090 0x7fc8c014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.136+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/4115684872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c01424d0 0x7fc8c0072ca0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.136+0000 7fc8c4a00640 1 -- 172.21.15.16:0/4115684872 >> 172.21.15.16:0/4115684872 conn(0x7fc8c006e020 msgr2=0x7fc8c006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.136+0000 7fc8c4a00640 1 -- 172.21.15.16:0/4115684872 shutdown_connections 2024-04-26T23:35:01.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.136+0000 7fc8c4a00640 1 -- 172.21.15.16:0/4115684872 wait complete. 2024-04-26T23:35:01.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.137+0000 7fc8c4a00640 1 Processor -- start 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.137+0000 7fc8c4a00640 1 -- start start 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.138+0000 7fc8c4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c0068090 0x7fc8c01417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.138+0000 7fc8c4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c0068510 0x7fc8c01e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.138+0000 7fc8c4a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c01424d0 0x7fc8c013aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.138+0000 7fc8c4a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00731e0 con 0x7fc8c0068510 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.138+0000 7fc8c4a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c014ba50 con 0x7fc8c0068090 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.138+0000 7fc8c4a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c00b7430 con 0x7fc8c01424d0 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.138+0000 7fc8b5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c0068510 0x7fc8c01e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c0068510 0x7fc8c01e1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49016/0 (socket says 172.21.15.16:49016) 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 -- 172.21.15.16:0/1489323339 learned_addr learned my addr 172.21.15.16:0/1489323339 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8bde00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c0068090 0x7fc8c01417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8be800640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c01424d0 0x7fc8c013aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 -- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c01424d0 msgr2=0x7fc8c013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c01424d0 0x7fc8c013aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 -- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c0068090 msgr2=0x7fc8c01417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c0068090 0x7fc8c01417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 -- 172.21.15.16:0/1489323339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c01e20d0 con 0x7fc8c0068510 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8bde00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c0068090 0x7fc8c01417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.139+0000 7fc8b5400640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c0068510 0x7fc8c01e1a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c7c0 tx=0x7fc8a800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.140+0000 7fc8b6a00640 1 -- 172.21.15.16:0/1489323339 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8015070 con 0x7fc8c0068510 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.140+0000 7fc8b6a00640 1 -- 172.21.15.16:0/1489323339 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a80079d0 con 0x7fc8c0068510 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.140+0000 7fc8b6a00640 1 -- 172.21.15.16:0/1489323339 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8007da0 con 0x7fc8c0068510 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.140+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c01e23b0 con 0x7fc8c0068510 2024-04-26T23:35:01.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.140+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c01d3230 con 0x7fc8c0068510 2024-04-26T23:35:01.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.141+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c0076600 con 0x7fc8c0068510 2024-04-26T23:35:01.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.142+0000 7fc8b6a00640 1 -- 172.21.15.16:0/1489323339 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8a8018070 con 0x7fc8c0068510 2024-04-26T23:35:01.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.143+0000 7fc8b6a00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc89c06c8f0 0x7fc89c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.143+0000 7fc8b6a00640 1 -- 172.21.15.16:0/1489323339 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc8a808ba60 con 0x7fc8c0068510 2024-04-26T23:35:01.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.143+0000 7fc8bde00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc89c06c8f0 0x7fc89c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.144+0000 7fc8bde00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc89c06c8f0 0x7fc89c06edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0034000 tx=0x7fc8b002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:01.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.147+0000 7fc8b6a00640 1 -- 172.21.15.16:0/1489323339 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc8a8059e80 con 0x7fc8c0068510 2024-04-26T23:35:01.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.354+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc8c01e28d0 con 0x7fc8c0068510 2024-04-26T23:35:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.356+0000 7fc8b6a00640 1 -- 172.21.15.16:0/1489323339 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fc8a8059780 con 0x7fc8c0068510 2024-04-26T23:35:01.359 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T23:35:01.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc89c06c8f0 msgr2=0x7fc89c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc89c06c8f0 0x7fc89c06edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0034000 tx=0x7fc8b002e000 comp rx=0 tx=0).stop 2024-04-26T23:35:01.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c0068510 msgr2=0x7fc8c01e1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c0068510 0x7fc8c01e1a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c7c0 tx=0x7fc8a800cc80 comp rx=0 tx=0).stop 2024-04-26T23:35:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 shutdown_connections 2024-04-26T23:35:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc89c06c8f0 0x7fc89c06edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc8c01424d0 0x7fc8c013aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8c0068510 0x7fc8c01e1a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 --2- 172.21.15.16:0/1489323339 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c0068090 0x7fc8c01417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 >> 172.21.15.16:0/1489323339 conn(0x7fc8c006e020 msgr2=0x7fc8c00b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:01.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 shutdown_connections 2024-04-26T23:35:01.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.359+0000 7fc8c4a00640 1 -- 172.21.15.16:0/1489323339 wait complete. 2024-04-26T23:35:01.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:35:01.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.583+0000 7fc7f4a00640 1 Processor -- start 2024-04-26T23:35:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.583+0000 7fc7f4a00640 1 -- start start 2024-04-26T23:35:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.584+0000 7fc7f4a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc7f0073600 0x7fc7f01461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7f4a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f00b6e70 con 0x7fc7f00b6a90 2024-04-26T23:35:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7f4a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f00b39a0 con 0x7fc7f00701e0 2024-04-26T23:35:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7f4a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f00b3cf0 con 0x7fc7f0073600 2024-04-26T23:35:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7ee800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc7f00b6a90 0x7fc7f0072ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41194/0 (socket says 172.21.15.16:41194) 2024-04-26T23:35:01.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7ee800640 1 -- 172.21.15.16:0/2758031473 learned_addr learned my addr 172.21.15.16:0/2758031473 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:35:01.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7e7e00640 1 --2- 172.21.15.16:0/2758031473 >> v2:172.21.15.16:3300/0 conn(0x7fc7f0073600 0x7fc7f01461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7ede00640 1 -- 172.21.15.16:0/2758031473 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465262282 0 0) 0x7fc7f00b6e70 con 0x7fc7f00b6a90 2024-04-26T23:35:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7ede00640 1 -- 172.21.15.16:0/2758031473 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7d4003520 con 0x7fc7f00b6a90 2024-04-26T23:35:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7e7e00640 1 -- 172.21.15.16:0/2758031473 >> v1:172.21.15.32:6789/0 conn(0x7fc7f00701e0 legacy=0x7fc7f0150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7e7e00640 1 -- 172.21.15.16:0/2758031473 >> v1:172.21.15.16:6789/0 conn(0x7fc7f00b6a90 legacy=0x7fc7f0072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.585+0000 7fc7e7e00640 1 -- 172.21.15.16:0/2758031473 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0073ca0 con 0x7fc7f0073600 2024-04-26T23:35:01.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.586+0000 7fc7e7e00640 1 --2- 172.21.15.16:0/2758031473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01461c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80097a0 tx=0x7fc7d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc52043fe7e4c8dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.587+0000 7fc7ede00640 1 -- 172.21.15.16:0/2758031473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8037070 con 0x7fc7f0073600 2024-04-26T23:35:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.587+0000 7fc7ede00640 1 -- 172.21.15.16:0/2758031473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d8032440 con 0x7fc7f0073600 2024-04-26T23:35:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.587+0000 7fc7ede00640 1 -- 172.21.15.16:0/2758031473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d802ae60 con 0x7fc7f0073600 2024-04-26T23:35:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.587+0000 7fc7f4a00640 1 -- 172.21.15.16:0/2758031473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 msgr2=0x7fc7f01461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.587+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/2758031473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01461c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80097a0 tx=0x7fc7d802a110 comp rx=0 tx=0).stop 2024-04-26T23:35:01.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.588+0000 7fc7f4a00640 1 -- 172.21.15.16:0/2758031473 shutdown_connections 2024-04-26T23:35:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.588+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/2758031473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01461c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.588+0000 7fc7f4a00640 1 -- 172.21.15.16:0/2758031473 >> 172.21.15.16:0/2758031473 conn(0x7fc7f0068270 msgr2=0x7fc7f0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.588+0000 7fc7f4a00640 1 -- 172.21.15.16:0/2758031473 shutdown_connections 2024-04-26T23:35:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.588+0000 7fc7f4a00640 1 -- 172.21.15.16:0/2758031473 wait complete. 2024-04-26T23:35:01.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.589+0000 7fc7f4a00640 1 Processor -- start 2024-04-26T23:35:01.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.589+0000 7fc7f4a00640 1 -- start start 2024-04-26T23:35:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7f4a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7f00701e0 0x7fc7f00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7f4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01e1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7f4a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b6a90 0x7fc7f013e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7f4a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0146a90 con 0x7fc7f0073600 2024-04-26T23:35:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7f4a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0146910 con 0x7fc7f00b6a90 2024-04-26T23:35:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7f4a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f0146c10 con 0x7fc7f00701e0 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7e7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01e1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7e7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01e1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49032/0 (socket says 172.21.15.16:49032) 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.590+0000 7fc7e7e00640 1 -- 172.21.15.16:0/433217409 learned_addr learned my addr 172.21.15.16:0/433217409 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e7e00640 1 -- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7f00701e0 msgr2=0x7fc7f00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e7e00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7f00701e0 0x7fc7f00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e7e00640 1 -- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b6a90 msgr2=0x7fc7f013e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e7e00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b6a90 0x7fc7f013e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e7e00640 1 -- 172.21.15.16:0/433217409 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0143b60 con 0x7fc7f0073600 2024-04-26T23:35:01.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e7e00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01e1840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80097a0 tx=0x7fc7d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:01.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e6a00640 1 -- 172.21.15.16:0/433217409 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8037050 con 0x7fc7f0073600 2024-04-26T23:35:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e6a00640 1 -- 172.21.15.16:0/433217409 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d8038040 con 0x7fc7f0073600 2024-04-26T23:35:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7e6a00640 1 -- 172.21.15.16:0/433217409 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8004490 con 0x7fc7f0073600 2024-04-26T23:35:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.591+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f01e1040 con 0x7fc7f0073600 2024-04-26T23:35:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.592+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f00b2c50 con 0x7fc7f0073600 2024-04-26T23:35:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.592+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f0076600 con 0x7fc7f0073600 2024-04-26T23:35:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.593+0000 7fc7e6a00640 1 -- 172.21.15.16:0/433217409 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc7d803c6d0 con 0x7fc7f0073600 2024-04-26T23:35:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.594+0000 7fc7e6a00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc7cc06c8f0 0x7fc7cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.594+0000 7fc7e6a00640 1 -- 172.21.15.16:0/433217409 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc7d80ac5d0 con 0x7fc7f0073600 2024-04-26T23:35:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.595+0000 7fc7ee800640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc7cc06c8f0 0x7fc7cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:01.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.596+0000 7fc7ee800640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc7cc06c8f0 0x7fc7cc06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0147500 tx=0x7fc7e0007930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.599+0000 7fc7e6a00640 1 -- 172.21.15.16:0/433217409 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc7d807aa90 con 0x7fc7f0073600 2024-04-26T23:35:01.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.839+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7f006c940 con 0x7fc7f0073600 2024-04-26T23:35:01.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.840+0000 7fc7e6a00640 1 -- 172.21.15.16:0/433217409 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fc7d807a390 con 0x7fc7f0073600 2024-04-26T23:35:01.844 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:35:01.844 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:34:45.529018+0000","modified":"2024-04-26T23:34:48.591854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1571792382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1571792382},{"type":"v1","addr":"172.21.15.32:6835","nonce":1571792382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-26T23:35:01.845 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-26T23:35:01.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc7cc06c8f0 msgr2=0x7fc7cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc7cc06c8f0 0x7fc7cc06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0147500 tx=0x7fc7e0007930 comp rx=0 tx=0).stop 2024-04-26T23:35:01.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 msgr2=0x7fc7f01e1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:01.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01e1840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7d80097a0 tx=0x7fc7d80046c0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 shutdown_connections 2024-04-26T23:35:01.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc7cc06c8f0 0x7fc7cc06edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7f00b6a90 0x7fc7f013e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7f0073600 0x7fc7f01e1840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 --2- 172.21.15.16:0/433217409 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc7f00701e0 0x7fc7f00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:01.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 >> 172.21.15.16:0/433217409 conn(0x7fc7f0068270 msgr2=0x7fc7f0144cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:01.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 shutdown_connections 2024-04-26T23:35:01.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:01.843+0000 7fc7f4a00640 1 -- 172.21.15.16:0/433217409 wait complete. 2024-04-26T23:35:01.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:35:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.071+0000 7f31e9e00640 1 Processor -- start 2024-04-26T23:35:02.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.072+0000 7f31e9e00640 1 -- start start 2024-04-26T23:35:02.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e9e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31e40bd7a0 0x7f31e4148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e9e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31e4073420 0x7f31e4073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e9e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e40bc010 con 0x7f31e40bbc30 2024-04-26T23:35:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e9e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f31e4149220 con 0x7f31e4073420 2024-04-26T23:35:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e9e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f31e4148220 con 0x7f31e40bd7a0 2024-04-26T23:35:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e8a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f31e40bbc30 0x7f31e40baa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41208/0 (socket says 172.21.15.16:41208) 2024-04-26T23:35:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e8a00640 1 -- 172.21.15.16:0/1666859837 learned_addr learned my addr 172.21.15.16:0/1666859837 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:35:02.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.073+0000 7f31e9400640 1 --2- 172.21.15.16:0/1666859837 >> v2:172.21.15.16:3300/0 conn(0x7f31e4073420 0x7f31e4073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.074+0000 7f31e3e00640 1 --2- 172.21.15.16:0/1666859837 >> v2:172.21.15.32:3300/0 conn(0x7f31e40bd7a0 0x7f31e4148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.074+0000 7f31e3400640 1 -- 172.21.15.16:0/1666859837 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899851514 0 0) 0x7f31e40bc010 con 0x7f31e40bbc30 2024-04-26T23:35:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.074+0000 7f31e3400640 1 -- 172.21.15.16:0/1666859837 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c4003520 con 0x7f31e40bbc30 2024-04-26T23:35:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.074+0000 7f31e9400640 1 -- 172.21.15.16:0/1666859837 >> v2:172.21.15.32:3300/0 conn(0x7f31e40bd7a0 msgr2=0x7f31e4148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.074+0000 7f31e9400640 1 --2- 172.21.15.16:0/1666859837 >> v2:172.21.15.32:3300/0 conn(0x7f31e40bd7a0 0x7f31e4148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.074+0000 7f31e9400640 1 -- 172.21.15.16:0/1666859837 >> v1:172.21.15.16:6789/0 conn(0x7f31e40bbc30 legacy=0x7f31e40baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.074+0000 7f31e9400640 1 -- 172.21.15.16:0/1666859837 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e41484e0 con 0x7f31e4073420 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.075+0000 7f31e9400640 1 --2- 172.21.15.16:0/1666859837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e4073cf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31e414c8b0 tx=0x7f31dc02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663eafeba2260db2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.075+0000 7f31e3400640 1 -- 172.21.15.16:0/1666859837 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc007740 con 0x7f31e4073420 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.075+0000 7f31e3400640 1 -- 172.21.15.16:0/1666859837 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0078e0 con 0x7f31e4073420 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.075+0000 7f31e3400640 1 -- 172.21.15.16:0/1666859837 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc007c90 con 0x7f31e4073420 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 -- 172.21.15.16:0/1666859837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 msgr2=0x7f31e4073cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 --2- 172.21.15.16:0/1666859837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e4073cf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31e414c8b0 tx=0x7f31dc02a560 comp rx=0 tx=0).stop 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 -- 172.21.15.16:0/1666859837 shutdown_connections 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 --2- 172.21.15.16:0/1666859837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e4073cf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 --2- 172.21.15.16:0/1666859837 >> v2:172.21.15.32:3300/0 conn(0x7f31e40bd7a0 0x7f31e4148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 -- 172.21.15.16:0/1666859837 >> 172.21.15.16:0/1666859837 conn(0x7f31e409fc60 msgr2=0x7f31e40a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 -- 172.21.15.16:0/1666859837 shutdown_connections 2024-04-26T23:35:02.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.076+0000 7f31e9e00640 1 -- 172.21.15.16:0/1666859837 wait complete. 2024-04-26T23:35:02.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.078+0000 7f31e9e00640 1 Processor -- start 2024-04-26T23:35:02.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.078+0000 7f31e9e00640 1 -- start start 2024-04-26T23:35:02.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e40b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e9e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f31e40bbc30 0x7f31e4142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e9e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e40bd7a0 0x7f31e41e0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e9e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f31e40743b0 con 0x7f31e4073420 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e9e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f31e4074230 con 0x7f31e40bd7a0 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e9e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f31e4074530 con 0x7f31e40bbc30 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e40b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e40b7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49056/0 (socket says 172.21.15.16:49056) 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 -- 172.21.15.16:0/4082599027 learned_addr learned my addr 172.21.15.16:0/4082599027 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e3e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f31e40bbc30 0x7f31e4142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e9400640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e40bd7a0 0x7f31e41e0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 -- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f31e40bbc30 msgr2=0x7f31e4142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f31e40bbc30 0x7f31e4142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 -- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e40bd7a0 msgr2=0x7f31e41e0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e40bd7a0 0x7f31e41e0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.079+0000 7f31e8a00640 1 -- 172.21.15.16:0/4082599027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e4145060 con 0x7f31e4073420 2024-04-26T23:35:02.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e9400640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e40bd7a0 0x7f31e41e0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e3e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f31e40bbc30 0x7f31e4142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e8a00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e40b7d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31d40010e0 tx=0x7f31d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e0c00640 1 -- 172.21.15.16:0/4082599027 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4017070 con 0x7f31e4073420 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e0c00640 1 -- 172.21.15.16:0/4082599027 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d4005d00 con 0x7f31e4073420 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e0c00640 1 -- 172.21.15.16:0/4082599027 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40072b0 con 0x7f31e4073420 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e4145790 con 0x7f31e4073420 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.080+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e4144d80 con 0x7f31e4073420 2024-04-26T23:35:02.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.082+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e4145960 con 0x7f31e4073420 2024-04-26T23:35:02.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.083+0000 7f31e0c00640 1 -- 172.21.15.16:0/4082599027 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31d401a070 con 0x7f31e4073420 2024-04-26T23:35:02.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.083+0000 7f31e0c00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f31c006c8f0 0x7f31c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.084+0000 7f31e0c00640 1 -- 172.21.15.16:0/4082599027 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31d408afe0 con 0x7f31e4073420 2024-04-26T23:35:02.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.084+0000 7f31e3e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f31c006c8f0 0x7f31c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.085+0000 7f31e3e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f31c006c8f0 0x7f31c006edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31cc006fd0 tx=0x7f31cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:02.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.088+0000 7f31e0c00640 1 -- 172.21.15.16:0/4082599027 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f31d4059400 con 0x7f31e4073420 2024-04-26T23:35:02.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.307+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31e4076600 con 0x7f31e4073420 2024-04-26T23:35:02.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.309+0000 7f31e0c00640 1 -- 172.21.15.16:0/4082599027 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16561 (secure 0 0 0) 0x7f31d4058d00 con 0x7f31e4073420 2024-04-26T23:35:02.313 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:35:02.313 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:34:47.057746+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:35:02.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.311+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f31c006c8f0 msgr2=0x7f31c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.311+0000 7f31e9e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f31c006c8f0 0x7f31c006edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31cc006fd0 tx=0x7f31cc008040 comp rx=0 tx=0).stop 2024-04-26T23:35:02.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.311+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 msgr2=0x7f31e40b7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.311+0000 7f31e9e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e40b7d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31d40010e0 tx=0x7f31d400c960 comp rx=0 tx=0).stop 2024-04-26T23:35:02.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 shutdown_connections 2024-04-26T23:35:02.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f31c006c8f0 0x7f31c006edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31e40bd7a0 0x7f31e41e0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f31e40bbc30 0x7f31e4142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 --2- 172.21.15.16:0/4082599027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31e4073420 0x7f31e40b7d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 >> 172.21.15.16:0/4082599027 conn(0x7f31e409fc60 msgr2=0x7f31e409bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 shutdown_connections 2024-04-26T23:35:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.312+0000 7f31e9e00640 1 -- 172.21.15.16:0/4082599027 wait complete. 2024-04-26T23:35:02.336 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:35:02.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.542+0000 7efc52600640 1 Processor -- start 2024-04-26T23:35:02.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.542+0000 7efc52600640 1 -- start start 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.543+0000 7efc52600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efc4c0ba3f0 0x7efc4c142170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.543+0000 7efc52600640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efc4c14c270 0x7efc4c1426b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.543+0000 7efc52600640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4c0beac0 con 0x7efc4c0be6e0 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.543+0000 7efc52600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7efc4c0b57c0 con 0x7efc4c0ba3f0 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.543+0000 7efc52600640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7efc4c0b5aa0 con 0x7efc4c14c270 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.543+0000 7efc42a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efc4c0ba3f0 0x7efc4c142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.544+0000 7efc42a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efc4c0ba3f0 0x7efc4c142170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49060/0 (socket says 172.21.15.16:49060) 2024-04-26T23:35:02.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.544+0000 7efc42a00640 1 -- 172.21.15.16:0/2803351407 learned_addr learned my addr 172.21.15.16:0/2803351407 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.544+0000 7efc4be00640 1 --2- 172.21.15.16:0/2803351407 >> v2:172.21.15.32:3300/0 conn(0x7efc4c14c270 0x7efc4c1426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.544+0000 7efc42a00640 1 -- 172.21.15.16:0/2803351407 >> v2:172.21.15.32:3300/0 conn(0x7efc4c14c270 msgr2=0x7efc4c1426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.544+0000 7efc42a00640 1 --2- 172.21.15.16:0/2803351407 >> v2:172.21.15.32:3300/0 conn(0x7efc4c14c270 0x7efc4c1426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.544+0000 7efc42a00640 1 -- 172.21.15.16:0/2803351407 >> v1:172.21.15.32:6789/0 conn(0x7efc4c0be6e0 legacy=0x7efc4c14bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:02.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.544+0000 7efc42a00640 1 -- 172.21.15.16:0/2803351407 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c0b5d80 con 0x7efc4c0ba3f0 2024-04-26T23:35:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.545+0000 7efc42a00640 1 --2- 172.21.15.16:0/2803351407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c0ba3f0 0x7efc4c142170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc4c14cb50 tx=0x7efc3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6607f31d0fb5ce49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.545+0000 7efc4aa00640 1 -- 172.21.15.16:0/2803351407 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34037070 con 0x7efc4c0ba3f0 2024-04-26T23:35:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc4aa00640 1 -- 172.21.15.16:0/2803351407 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc34032440 con 0x7efc4c0ba3f0 2024-04-26T23:35:02.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc4aa00640 1 -- 172.21.15.16:0/2803351407 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34032810 con 0x7efc4c0ba3f0 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc52600640 1 -- 172.21.15.16:0/2803351407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c0ba3f0 msgr2=0x7efc4c142170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc52600640 1 --2- 172.21.15.16:0/2803351407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c0ba3f0 0x7efc4c142170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc4c14cb50 tx=0x7efc3402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc52600640 1 -- 172.21.15.16:0/2803351407 shutdown_connections 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc52600640 1 --2- 172.21.15.16:0/2803351407 >> v2:172.21.15.32:3300/0 conn(0x7efc4c14c270 0x7efc4c1426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc52600640 1 --2- 172.21.15.16:0/2803351407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c0ba3f0 0x7efc4c142170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc52600640 1 -- 172.21.15.16:0/2803351407 >> 172.21.15.16:0/2803351407 conn(0x7efc4c0686c0 msgr2=0x7efc4c0bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.546+0000 7efc52600640 1 -- 172.21.15.16:0/2803351407 shutdown_connections 2024-04-26T23:35:02.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.547+0000 7efc52600640 1 -- 172.21.15.16:0/2803351407 wait complete. 2024-04-26T23:35:02.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.548+0000 7efc52600640 1 Processor -- start 2024-04-26T23:35:02.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.548+0000 7efc52600640 1 -- start start 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc52600640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc4c0be6e0 0x7efc4c14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc52600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c14c270 0x7efc4c13c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc52600640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efc4c13c960 0x7efc4c149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc52600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c0b6d80 con 0x7efc4c14c270 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc52600640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c0b6c00 con 0x7efc4c0be6e0 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc52600640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7efc4c152df0 con 0x7efc4c13c960 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc42a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c14c270 0x7efc4c13c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc42a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c14c270 0x7efc4c13c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49064/0 (socket says 172.21.15.16:49064) 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.549+0000 7efc42a00640 1 -- 172.21.15.16:0/1815308219 learned_addr learned my addr 172.21.15.16:0/1815308219 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc42a00640 1 -- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efc4c13c960 msgr2=0x7efc4c149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc42a00640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efc4c13c960 0x7efc4c149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc42a00640 1 -- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc4c0be6e0 msgr2=0x7efc4c14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc42a00640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc4c0be6e0 0x7efc4c14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc42a00640 1 -- 172.21.15.16:0/1815308219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c14a4b0 con 0x7efc4c14c270 2024-04-26T23:35:02.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc42a00640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c14c270 0x7efc4c13c420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc34000c00 tx=0x7efc340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:02.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc43e00640 1 -- 172.21.15.16:0/1815308219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34041020 con 0x7efc4c14c270 2024-04-26T23:35:02.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc43e00640 1 -- 172.21.15.16:0/1815308219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc340306c0 con 0x7efc4c14c270 2024-04-26T23:35:02.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4c14a790 con 0x7efc4c14c270 2024-04-26T23:35:02.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc43e00640 1 -- 172.21.15.16:0/1815308219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34037040 con 0x7efc4c14c270 2024-04-26T23:35:02.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.550+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4c149630 con 0x7efc4c14c270 2024-04-26T23:35:02.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.552+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4c14b890 con 0x7efc4c14c270 2024-04-26T23:35:02.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.553+0000 7efc43e00640 1 -- 172.21.15.16:0/1815308219 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc34044020 con 0x7efc4c14c270 2024-04-26T23:35:02.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.553+0000 7efc43e00640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efc2806c8f0 0x7efc2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:02.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.554+0000 7efc43e00640 1 -- 172.21.15.16:0/1815308219 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efc340ac340 con 0x7efc4c14c270 2024-04-26T23:35:02.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.554+0000 7efc4b400640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efc2806c8f0 0x7efc2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:02.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.555+0000 7efc4b400640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efc2806c8f0 0x7efc2806edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc3c003cc0 tx=0x7efc3c0079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:02.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.558+0000 7efc43e00640 1 -- 172.21.15.16:0/1815308219 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efc3404b030 con 0x7efc4c14c270 2024-04-26T23:35:02.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.801+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc4c0693a0 con 0x7efc4c14c270 2024-04-26T23:35:02.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.802+0000 7efc43e00640 1 -- 172.21.15.16:0/1815308219 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7efc3407a800 con 0x7efc4c14c270 2024-04-26T23:35:02.974 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T23:35:02.974 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:34:45.529018+0000","modified":"2024-04-26T23:34:48.591854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1571792382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1571792382},{"type":"v1","addr":"172.21.15.32:6835","nonce":1571792382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efc2806c8f0 msgr2=0x7efc2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efc2806c8f0 0x7efc2806edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc3c003cc0 tx=0x7efc3c0079b0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c14c270 msgr2=0x7efc4c13c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c14c270 0x7efc4c13c420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc34000c00 tx=0x7efc340046c0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 shutdown_connections 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7efc2806c8f0 0x7efc2806edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7efc4c13c960 0x7efc4c149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efc4c14c270 0x7efc4c13c420 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 --2- 172.21.15.16:0/1815308219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc4c0be6e0 0x7efc4c14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:02.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 >> 172.21.15.16:0/1815308219 conn(0x7efc4c0686c0 msgr2=0x7efc4c0b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:02.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 shutdown_connections 2024-04-26T23:35:02.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:02.805+0000 7efc52600640 1 -- 172.21.15.16:0/1815308219 wait complete. 2024-04-26T23:35:03.178 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:34:45.529018+0000', 'modified': '2024-04-26T23:34:48.591854+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.32:6835/1571792382', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.32:6834', 'nonce': 1571792382}, {'type': 'v1', 'addr': '172.21.15.32:6835', 'nonce': 1571792382}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4273, 'qdb_cluster': [4273]} 2024-04-26T23:35:03.179 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:35:03.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T23:35:03.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.389+0000 7f1f3b400640 1 Processor -- start 2024-04-26T23:35:03.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.389+0000 7f1f3b400640 1 -- start start 2024-04-26T23:35:03.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.390+0000 7f1f3b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1f340bd100 0x7f1f3414c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.391+0000 7f1f3b400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f340bd4e0 con 0x7f1f3409ba20 2024-04-26T23:35:03.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.391+0000 7f1f3b400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3414bcd0 con 0x7f1f340a0370 2024-04-26T23:35:03.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.391+0000 7f1f3b400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1f3409d4e0 con 0x7f1f340bd100 2024-04-26T23:35:03.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.391+0000 7f1f39400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1f3409ba20 0x7f1f34152ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41210/0 (socket says 172.21.15.16:41210) 2024-04-26T23:35:03.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.391+0000 7f1f39400640 1 -- 172.21.15.16:0/3056982300 learned_addr learned my addr 172.21.15.16:0/3056982300 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T23:35:03.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.391+0000 7f1f38a00640 1 --2- 172.21.15.16:0/3056982300 >> v2:172.21.15.16:3300/0 conn(0x7f1f340bd100 0x7f1f3414c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.391+0000 7f1f33400640 1 -- 172.21.15.16:0/3056982300 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122182924 0 0) 0x7f1f340bd4e0 con 0x7f1f3409ba20 2024-04-26T23:35:03.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.392+0000 7f1f33400640 1 -- 172.21.15.16:0/3056982300 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c003520 con 0x7f1f3409ba20 2024-04-26T23:35:03.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.392+0000 7f1f38a00640 1 -- 172.21.15.16:0/3056982300 >> v1:172.21.15.32:6789/0 conn(0x7f1f340a0370 legacy=0x7f1f3409cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.392+0000 7f1f38a00640 1 -- 172.21.15.16:0/3056982300 >> v1:172.21.15.16:6789/0 conn(0x7f1f3409ba20 legacy=0x7f1f34152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.392+0000 7f1f38a00640 1 -- 172.21.15.16:0/3056982300 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3409c090 con 0x7f1f340bd100 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.393+0000 7f1f38a00640 1 --2- 172.21.15.16:0/3056982300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f340bd100 0x7f1f3414c4d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f280097a0 tx=0x7f1f2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4499b1d7fa703d67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.393+0000 7f1f33400640 1 -- 172.21.15.16:0/3056982300 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28037070 con 0x7f1f340bd100 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.393+0000 7f1f33400640 1 -- 172.21.15.16:0/3056982300 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28032440 con 0x7f1f340bd100 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.393+0000 7f1f33400640 1 -- 172.21.15.16:0/3056982300 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28032810 con 0x7f1f340bd100 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.394+0000 7f1f3b400640 1 -- 172.21.15.16:0/3056982300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f340bd100 msgr2=0x7f1f3414c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.394+0000 7f1f3b400640 1 --2- 172.21.15.16:0/3056982300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f340bd100 0x7f1f3414c4d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f280097a0 tx=0x7f1f2802a230 comp rx=0 tx=0).stop 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.394+0000 7f1f3b400640 1 -- 172.21.15.16:0/3056982300 shutdown_connections 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.394+0000 7f1f3b400640 1 --2- 172.21.15.16:0/3056982300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f340bd100 0x7f1f3414c4d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.394+0000 7f1f3b400640 1 -- 172.21.15.16:0/3056982300 >> 172.21.15.16:0/3056982300 conn(0x7f1f34068800 msgr2=0x7f1f3409f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:03.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.394+0000 7f1f3b400640 1 -- 172.21.15.16:0/3056982300 shutdown_connections 2024-04-26T23:35:03.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.394+0000 7f1f3b400640 1 -- 172.21.15.16:0/3056982300 wait complete. 2024-04-26T23:35:03.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.395+0000 7f1f3b400640 1 Processor -- start 2024-04-26T23:35:03.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.396+0000 7f1f3b400640 1 -- start start 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.396+0000 7f1f3b400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1f3409ba20 0x7f1f34145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.396+0000 7f1f3b400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f340bd100 0x7f1f3409e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.396+0000 7f1f3b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f341ddd90 0x7f1f34141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.396+0000 7f1f3b400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3414c040 con 0x7f1f341ddd90 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.396+0000 7f1f3b400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3409c720 con 0x7f1f340bd100 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.396+0000 7f1f3b400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3414ca10 con 0x7f1f3409ba20 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f341ddd90 0x7f1f34141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f341ddd90 0x7f1f34141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49078/0 (socket says 172.21.15.16:49078) 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 -- 172.21.15.16:0/959445168 learned_addr learned my addr 172.21.15.16:0/959445168 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f38a00640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1f3409ba20 0x7f1f34145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f33e00640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f340bd100 0x7f1f3409e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 -- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1f3409ba20 msgr2=0x7f1f34145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1f3409ba20 0x7f1f34145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 -- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f340bd100 msgr2=0x7f1f3409e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f340bd100 0x7f1f3409e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 -- 172.21.15.16:0/959445168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f341e1630 con 0x7f1f341ddd90 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f33e00640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f340bd100 0x7f1f3409e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.397+0000 7f1f39400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f341ddd90 0x7f1f34141be0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cbb0 tx=0x7f1f2c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.398+0000 7f1f30c00640 1 -- 172.21.15.16:0/959445168 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c017070 con 0x7f1f341ddd90 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.398+0000 7f1f30c00640 1 -- 172.21.15.16:0/959445168 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00ad40 con 0x7f1f341ddd90 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.398+0000 7f1f30c00640 1 -- 172.21.15.16:0/959445168 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c012600 con 0x7f1f341ddd90 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.398+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f341e1910 con 0x7f1f341ddd90 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.398+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3409f1e0 con 0x7f1f341ddd90 2024-04-26T23:35:03.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.400+0000 7f1f30c00640 1 -- 172.21.15.16:0/959445168 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f2c01a070 con 0x7f1f341ddd90 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.402+0000 7f1f30c00640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f1f1406c8f0 0x7f1f1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.402+0000 7f1f30c00640 1 -- 172.21.15.16:0/959445168 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1f2c08b850 con 0x7f1f341ddd90 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.402+0000 7f1f3e19a740 1 Processor -- start 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.402+0000 7f1f38a00640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f1f1406c8f0 0x7f1f1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f3e19a740 1 -- start start 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111a8530 0x556d111d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111d37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f38a00640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f1f1406c8f0 0x7f1f1406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556d1110f600 con 0x556d111d3380 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x556d110ac100 con 0x556d111a8530 2024-04-26T23:35:03.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.403+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x556d1110b5c0 con 0x556d111aae80 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111d37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111d37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49082/0 (socket says 172.21.15.16:49082) 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 -- 172.21.15.16:0/3141013575 learned_addr learned my addr 172.21.15.16:0/3141013575 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f38a00640 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f33e00640 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111a8530 0x556d111d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 -- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 msgr2=0x556d111a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111a6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 -- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111a8530 msgr2=0x556d111d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111a8530 0x556d111d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 -- 172.21.15.16:0/3141013575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d10e212d0 con 0x556d111d3380 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.404+0000 7f1f39400640 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111d37c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00afd0 tx=0x7f1f2c059290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60083ac5f875b856 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f25200640 1 -- 172.21.15.16:0/3141013575 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c055c90 con 0x556d111d3380 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f25200640 1 -- 172.21.15.16:0/3141013575 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c061cc0 con 0x556d111d3380 2024-04-26T23:35:03.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f25200640 1 -- 172.21.15.16:0/3141013575 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c004b60 con 0x556d111d3380 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f3e19a740 1 -- 172.21.15.16:0/3141013575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 msgr2=0x556d111d37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111d37c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00afd0 tx=0x7f1f2c059290 comp rx=0 tx=0).stop 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f3e19a740 1 -- 172.21.15.16:0/3141013575 shutdown_connections 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111a8530 0x556d111d2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111d37c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/3141013575 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.405+0000 7f1f3e19a740 1 -- 172.21.15.16:0/3141013575 >> 172.21.15.16:0/3141013575 conn(0x556d1113fd10 msgr2=0x556d111aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.406+0000 7f1f3e19a740 1 -- 172.21.15.16:0/3141013575 shutdown_connections 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.406+0000 7f1f3e19a740 1 -- 172.21.15.16:0/3141013575 wait complete. 2024-04-26T23:35:03.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.406+0000 7f1f3e19a740 1 -- start start 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.406+0000 7f1f3e19a740 1 Processor -- start 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.407+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111aae80 0x556d111ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.407+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111dc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.407+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111da230 0x556d111dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.407+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556d111d8360 con 0x556d111d3380 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.407+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x556d11096f70 con 0x556d111aae80 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.407+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x556d111a6730 con 0x556d111da230 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f3e19a740 10 client.0 _ll_register_callbacks cb 0x556d11105480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:35:03.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111dc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111dc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49086/0 (socket says 172.21.15.16:49086) 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 -- 172.21.15.16:0/2340826325 learned_addr learned my addr 172.21.15.16:0/2340826325 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111aae80 0x556d111ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f39400640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111da230 0x556d111dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 -- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111da230 msgr2=0x556d111dcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111da230 0x556d111dcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 -- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111aae80 msgr2=0x556d111ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111aae80 0x556d111ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 -- 172.21.15.16:0/2340826325 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d10eeb6b0 con 0x556d111d3380 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111aae80 0x556d111ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111dc730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1f34074870 tx=0x7f1f2000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed926b0a99547a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.408+0000 7f1f19600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f19600640 1 -- 172.21.15.16:0/2340826325 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f200050d0 con 0x556d111d3380 2024-04-26T23:35:03.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f19600640 1 -- 172.21.15.16:0/2340826325 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1f20005270 con 0x556d111d3380 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f2c061cc0 con 0x556d111d3380 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f19600640 1 -- 172.21.15.16:0/2340826325 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f1f20005470 con 0x556d111d3380 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 10 client.4632 fetch_fsmap learned FSMap version 7 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x556d111edc20 con 0x556d111d3380 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f19600640 1 -- 172.21.15.16:0/2340826325 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c061cc0 con 0x556d111d3380 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f19600640 1 -- 172.21.15.16:0/2340826325 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) ==== 2284+0+0 (secure 0 0 0) 0x7f1f200133f0 con 0x556d111d3380 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 10 client.4632 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 10 client.4632 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 20 client.4632 populate_metadata read hostname 'smithi016' 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111cb810 0x556d111caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 4 client.4632 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:35:03.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.409+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 --> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d1111d210 con 0x556d111cb810 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.410+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111cb810 0x556d111caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.411+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111cb810 0x556d111caae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ad12ad409619ce9 server_cookie=7314cea9e9c6796e in_seq=0 out_seq=0 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.411+0000 7f1f19600640 10 client.4632 ms_handle_connect on v2:172.21.15.32:6834/1571792382 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f19600640 1 -- 172.21.15.16:0/2340826325 <== mds.0 v2:172.21.15.32:6834/1571792382 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d1111d210 con 0x556d111cb810 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f19600640 10 client.4632 handle_command_reply: tid=0 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 client.4632 shutdown 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 msgr2=0x556d111dc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111dc730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1f34074870 tx=0x7f1f2000f5a0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 shutdown_connections 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111cb810 0x556d111caae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111da230 0x556d111dcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111dc730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2340826325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111aae80 0x556d111ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f19600640 0 client.4632 ms_handle_reset on v2:172.21.15.32:6834/1571792382 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.413+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 >> 172.21.15.16:0/2340826325 conn(0x556d1113fd10 msgr2=0x556d111a5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.414+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 shutdown_connections 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.414+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2340826325 wait complete. 2024-04-26T23:35:03.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.414+0000 7f1f3e19a740 20 client.4632 trim_cache size 0 max 16384 2024-04-26T23:35:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 Processor -- start 2024-04-26T23:35:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 -- start start 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111fdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111fe1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556d111a64d0 con 0x556d111d3380 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341ea850 con 0x556d111da230 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.434+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f1f341e99b0 con 0x556d111aae80 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111fdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49102/0 (socket says 172.21.15.16:49102) 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 -- 172.21.15.16:0/2084366162 learned_addr learned my addr 172.21.15.16:0/2084366162 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f39400640 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111fe1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 -- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 msgr2=0x556d111ddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111ddab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 -- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 msgr2=0x556d111fe1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111fe1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f33e00640 1 -- 172.21.15.16:0/2084366162 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d111d2d10 con 0x556d111d3380 2024-04-26T23:35:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.435+0000 7f1f39400640 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.436+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111fdca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f20013d60 tx=0x7f1f2000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d85147242407e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.436+0000 7f1f1be00640 1 -- 172.21.15.16:0/2084366162 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20020020 con 0x556d111d3380 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.436+0000 7f1f1be00640 1 -- 172.21.15.16:0/2084366162 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f20018070 con 0x556d111d3380 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.436+0000 7f1f1be00640 1 -- 172.21.15.16:0/2084366162 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20013b50 con 0x556d111d3380 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2084366162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 msgr2=0x556d111fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111fdca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f20013d60 tx=0x7f1f2000d000 comp rx=0 tx=0).stop 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2084366162 shutdown_connections 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111d3380 0x556d111fdca0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2084366162 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111aae80 0x556d111ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2084366162 >> 172.21.15.16:0/2084366162 conn(0x556d1113fd10 msgr2=0x556d111dab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2084366162 shutdown_connections 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2084366162 wait complete. 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.437+0000 7f1f3e19a740 1 -- start start 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.438+0000 7f1f3e19a740 1 Processor -- start 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.438+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111aae80 0x556d111cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111d3380 0x556d111dc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f3e19a740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556d111ca4e0 con 0x556d111aae80 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x556d111dd930 con 0x556d111da230 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f3e19a740 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x556d11096f70 con 0x556d111d3380 2024-04-26T23:35:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f3e19a740 10 client.0 _ll_register_callbacks cb 0x7f1f20007cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:35:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111aae80 0x556d111cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111aae80 0x556d111cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49104/0 (socket says 172.21.15.16:49104) 2024-04-26T23:35:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 -- 172.21.15.16:0/2455902796 learned_addr learned my addr 172.21.15.16:0/2455902796 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111d3380 0x556d111dc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f39400640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 -- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111d3380 msgr2=0x556d111dc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111d3380 0x556d111dc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 -- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 msgr2=0x556d111c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f38a00640 1 -- 172.21.15.16:0/2455902796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d111e6bb0 con 0x556d111aae80 2024-04-26T23:35:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.439+0000 7f1f39400640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f38a00640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111aae80 0x556d111cddd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f280098c0 tx=0x7f1f28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc1c01bcb504aa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f19600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f19600640 1 -- 172.21.15.16:0/2455902796 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28037040 con 0x556d111aae80 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f19600640 1 -- 172.21.15.16:0/2455902796 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1f28004040 con 0x556d111aae80 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f20018070 con 0x556d111aae80 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f19600640 1 -- 172.21.15.16:0/2455902796 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f1f2805c050 con 0x556d111aae80 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f3e19a740 10 client.4638 fetch_fsmap learned FSMap version 7 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x556d111c71c0 con 0x556d111aae80 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f19600640 1 -- 172.21.15.16:0/2455902796 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f20018070 con 0x556d111aae80 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f19600640 1 -- 172.21.15.16:0/2455902796 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) ==== 2284+0+0 (secure 0 0 0) 0x7f1f2805f020 con 0x556d111aae80 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f3e19a740 10 client.4638 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.440+0000 7f1f3e19a740 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.441+0000 7f1f3e19a740 20 client.4638 populate_metadata read hostname 'smithi016' 2024-04-26T23:35:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.441+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111db400 0x556d111db7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.441+0000 7f1f3e19a740 4 client.4638 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.441+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 --> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] -- command(tid 0: {"prefix": "status"}) -- 0x556d11117080 con 0x556d111db400 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.441+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111db400 0x556d111db7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.442+0000 7f1f33e00640 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111db400 0x556d111db7e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f23a146bbdf1a6 server_cookie=cbc3545a5aa41329 in_seq=0 out_seq=0 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.442+0000 7f1f19600640 10 client.4638 ms_handle_connect on v2:172.21.15.32:6834/1571792382 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f19600640 1 -- 172.21.15.16:0/2455902796 <== mds.0 v2:172.21.15.32:6834/1571792382 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x556d11117080 con 0x556d111db400 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f19600640 10 client.4638 handle_command_reply: tid=0 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 client.4638 shutdown 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111aae80 msgr2=0x556d111cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111aae80 0x556d111cddd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f280098c0 tx=0x7f1f28004730 comp rx=0 tx=0).stop 2024-04-26T23:35:03.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 shutdown_connections 2024-04-26T23:35:03.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:6834/1571792382,v1:172.21.15.32:6835/1571792382] conn(0x556d111db400 0x556d111db7e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x556d111da230 0x556d111c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x556d111d3380 0x556d111dc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 --2- 172.21.15.16:0/2455902796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d111aae80 0x556d111cddd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f19600640 0 client.4638 ms_handle_reset on v2:172.21.15.32:6834/1571792382 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 >> 172.21.15.16:0/2455902796 conn(0x556d1113fd10 msgr2=0x556d111aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 shutdown_connections 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.443+0000 7f1f3e19a740 1 -- 172.21.15.16:0/2455902796 wait complete. 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3e19a740 20 client.4638 trim_cache size 0 max 16384 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a", 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-26T23:35:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4273, 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 17.35952756, 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 7, 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 20, 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 20, 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 24.679627455999999 2024-04-26T23:35:03.451 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T23:35:03.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f1f1406c8f0 msgr2=0x7f1f1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f1f1406c8f0 0x7f1f1406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).stop 2024-04-26T23:35:03.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f341ddd90 msgr2=0x7f1f34141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:35:03.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f341ddd90 0x7f1f34141be0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cbb0 tx=0x7f1f2c00a430 comp rx=0 tx=0).stop 2024-04-26T23:35:03.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 shutdown_connections 2024-04-26T23:35:03.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f1f1406c8f0 0x7f1f1406edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1f340bd100 0x7f1f3409e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f341ddd90 0x7f1f34141be0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 --2- 172.21.15.16:0/959445168 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f1f3409ba20 0x7f1f34145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:35:03.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 >> 172.21.15.16:0/959445168 conn(0x7f1f34068800 msgr2=0x7f1f3406a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:35:03.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 shutdown_connections 2024-04-26T23:35:03.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T23:35:03.444+0000 7f1f3b400640 1 -- 172.21.15.16:0/959445168 wait complete. 2024-04-26T23:35:03.464 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T23:35:03.474 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T23:35:03.474 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T23:35:03.475 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T23:35:03.475 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T23:35:03.524 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:35:03.525 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T23:35:03.525 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:35:03.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:35:03.584 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-26T23:35:03.584 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:35:03.636 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-26T23:35:03.636 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-26T23:35:03.689 INFO:tasks.workunit:timeout=3h 2024-04-26T23:35:03.690 INFO:tasks.workunit:cleanup=True 2024-04-26T23:35:03.690 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:35:03.748 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T23:35:12.770 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:12.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:42.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:35:42.912 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:13.043 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:13.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:33.147 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 59% (7298/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 98% (12110/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T23:36:33.763 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T23:36:33.764 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T23:36:33.777 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T23:36:33.836 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T23:36:33.843 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T23:36:33.843 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T23:36:34.604 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T23:36:34.722 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T23:36:34.802 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T23:36:34.808 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T23:36:34.808 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T23:36:34.894 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T23:36:34.905 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T23:36:34.905 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T23:36:34.956 INFO:tasks.workunit:Running workunits matching fs/test_python.sh on client.0... 2024-04-26T23:36:34.958 INFO:tasks.workunit:Running workunit fs/test_python.sh... 2024-04-26T23:36:34.958 DEBUG:teuthology.orchestra.run.smithi016:workunit test fs/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh 2024-04-26T23:36:35.028 INFO:tasks.workunit.client.0.smithi016.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh 2024-04-26T23:36:35.031 INFO:tasks.workunit.client.0.smithi016.stderr:+ sudo python3 -m pytest -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/../../../src/test/pybind/test_cephfs.py 2024-04-26T23:36:35.305 INFO:tasks.workunit.client.0.smithi016.stdout:============================= test session starts ============================== 2024-04-26T23:36:35.305 INFO:tasks.workunit.client.0.smithi016.stdout:platform linux -- Python 3.9.18, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /bin/python3 2024-04-26T23:36:35.305 INFO:tasks.workunit.client.0.smithi016.stdout:cachedir: .pytest_cache 2024-04-26T23:36:35.305 INFO:tasks.workunit.client.0.smithi016.stdout:rootdir: /home/ubuntu/cephtest/clone.client.0/src/test/pybind, configfile: pytest.ini 2024-04-26T23:36:35.369 INFO:tasks.workunit.client.0.smithi016.stdout:collecting ... collected 56 items 2024-04-26T23:36:35.370 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-26T23:36:35.395 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_conf_get PASSED [ 1%] 2024-04-26T23:36:35.397 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_version PASSED [ 3%] 2024-04-26T23:36:35.408 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fstat PASSED [ 5%] 2024-04-26T23:36:35.417 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_statfs PASSED [ 7%] 2024-04-26T23:36:35.450 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_statx PASSED [ 8%] 2024-04-26T23:36:35.465 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_syncfs PASSED [ 10%] 2024-04-26T23:36:35.486 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fsync PASSED [ 12%] 2024-04-26T23:36:35.548 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_directory PASSED [ 14%] 2024-04-26T23:36:35.611 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_walk_dir PASSED [ 16%] 2024-04-26T23:36:35.645 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_xattr PASSED [ 17%] 2024-04-26T23:36:35.699 INFO:tasks.ceph.mds.b.smithi032.stderr:2024-04-26T23:36:35.696+0000 7f408e400640 -1 mds.0.server mirror info parse error 2024-04-26T23:36:35.702 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_ceph_mirror_xattr PASSED [ 19%] 2024-04-26T23:36:35.735 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_fxattr PASSED [ 21%] 2024-04-26T23:36:35.801 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_rename PASSED [ 23%] 2024-04-26T23:36:35.854 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_open PASSED [ 25%] 2024-04-26T23:36:35.892 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_link PASSED [ 26%] 2024-04-26T23:36:35.924 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_symlink PASSED [ 28%] 2024-04-26T23:36:35.963 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_readlink PASSED [ 30%] 2024-04-26T23:36:35.997 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_delete_cwd PASSED [ 32%] 2024-04-26T23:36:36.031 INFO:tasks.workunit.client.0.smithi016.stdout:../../../clone.client.0/src/test/pybind/test_cephfs.py::test_flock PASSED [ 33%] 2024-04-26T23:36:43.183 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:36:43.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:37:13.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:37:13.330 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:37:43.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:37:43.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:38:13.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:38:13.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:38:43.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:38:43.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:13.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:13.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:44.050 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:44.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:14.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:14.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:44.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:44.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:14.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:14.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:44.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:44.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:14.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:14.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:44.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:44.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:15.045 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:15.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:45.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:45.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:15.329 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:15.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:45.496 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:45.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:15.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:15.646 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:45.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:45.773 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:15.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:15.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:46.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:46.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:16.184 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:16.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:46.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:46.324 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:16.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:16.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:46.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:46.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:16.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:16.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:46.923 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:46.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:17.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:17.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:47.325 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:47.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:17.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:17.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:47.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:47.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:52:17.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:52:17.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:52:47.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:52:47.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:53:17.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:53:18.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:53:48.137 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:53:48.146 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:54:18.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:54:18.284 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:54:48.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:54:48.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:55:18.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:55:18.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:55:48.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:55:48.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:56:18.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:56:18.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:56:49.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:56:49.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:57:19.283 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:57:19.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:57:49.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:57:49.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:58:19.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:58:19.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:58:49.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:58:49.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:59:19.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:59:19.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:59:49.991 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:59:50.000 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:00:20.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:00:20.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:00:50.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:00:50.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:01:20.426 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:01:20.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:01:50.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:01:50.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:02:20.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:02:20.731 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:02:50.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:02:50.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:03:21.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:03:21.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:03:51.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:03:51.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:04:21.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:04:21.305 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:04:51.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:04:51.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:05:21.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:05:21.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:05:51.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:05:51.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:06:21.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:06:21.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:06:52.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:06:52.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:07:22.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:07:22.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:07:52.306 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:07:52.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:08:22.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:08:22.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:08:52.592 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:08:52.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:09:22.731 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:09:22.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:09:52.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:09:52.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:10:23.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:10:23.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:10:53.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:10:53.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:11:23.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:11:23.305 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:11:53.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:11:53.459 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:12:23.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:12:23.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:12:53.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:12:53.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:13:23.893 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:13:23.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:13:54.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:13:54.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:14:24.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:14:24.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:14:54.314 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:14:54.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:15:24.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:15:24.469 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:15:54.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:15:54.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:16:24.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:16:24.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:16:54.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:16:54.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:17:25.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:17:25.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:17:55.184 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:17:55.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:18:25.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:18:25.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:18:55.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:18:55.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:19:25.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:19:25.616 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:19:55.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:19:55.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:20:25.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:20:25.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:20:56.142 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:20:56.151 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:21:26.273 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:21:26.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:21:56.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:21:56.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:22:26.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:22:26.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:22:56.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:22:56.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:23:26.954 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:23:26.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:23:57.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:23:57.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:24:27.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:24:27.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:24:57.356 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:24:57.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:25:27.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:25:27.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:25:57.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:25:57.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:26:27.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:26:27.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:26:57.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:26:57.958 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:27:28.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:27:28.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:27:58.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:27:58.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:28:28.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:28:28.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:28:58.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:28:58.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:29:28.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:29:28.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:29:58.784 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:29:58.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:30:28.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:30:28.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:30:59.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:30:59.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:31:29.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:31:29.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:31:59.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:31:59.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:32:29.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:32:29.499 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:32:59.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:32:59.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:33:29.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:33:29.787 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:33:59.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:33:59.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:34:30.075 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:34:30.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:35:00.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:35:00.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:35:30.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:35:30.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:36:00.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:36:00.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:36:30.684 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:36:30.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:37:00.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:37:00.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:37:30.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:37:30.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:38:01.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:38:01.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:38:31.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:38:31.261 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:39:01.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:39:01.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:39:31.526 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:39:31.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:40:01.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:40:01.684 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:40:31.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:40:31.822 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:41:01.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:41:01.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:41:32.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:41:32.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:42:02.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:42:02.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:42:32.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:42:32.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:43:02.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:43:02.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:43:32.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:43:32.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:44:02.844 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:44:02.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:44:32.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:44:32.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:45:03.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:45:03.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:45:33.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:45:33.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:46:03.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:46:03.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:46:33.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:46:33.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:47:03.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:47:03.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:47:33.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:47:33.815 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:48:03.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:48:03.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:48:34.068 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:48:34.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:49:04.206 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:49:04.215 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:49:34.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:49:34.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:50:04.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:50:04.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:50:34.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:50:34.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:51:04.830 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:51:04.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:51:34.961 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:51:34.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:52:05.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:52:05.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:52:35.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:52:35.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:53:05.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:53:05.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:53:35.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:53:35.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:54:05.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:54:05.665 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:54:35.795 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:54:35.804 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:55:05.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:55:05.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:55:36.076 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:55:36.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:56:06.216 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:56:06.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:56:36.356 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:56:36.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:57:06.491 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:57:06.500 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:57:36.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:57:36.635 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:58:06.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:58:06.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:58:36.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:58:36.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:59:07.045 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:59:07.054 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:59:37.184 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T00:59:37.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:00:07.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:00:07.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:00:37.465 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:00:37.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:01:07.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:01:07.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:01:37.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:01:37.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:02:07.918 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:02:07.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:02:38.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:02:38.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:03:08.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:03:08.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:03:38.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:03:38.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:04:08.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:04:08.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:04:38.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:04:38.621 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:05:08.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:05:08.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:05:38.891 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:05:38.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:06:09.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:06:09.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:06:39.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:06:39.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:07:09.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:07:09.449 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:07:39.580 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:07:39.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:08:09.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:08:09.726 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:08:39.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:08:39.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:09:10.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:09:10.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:09:40.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:09:40.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:10:10.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:10:10.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:10:40.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:10:40.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:11:10.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:11:10.569 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:11:40.709 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:11:40.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:12:10.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:12:10.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:12:41.003 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:12:41.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:13:11.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:13:11.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:13:41.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:13:41.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:14:11.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:14:11.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:14:41.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:14:41.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:15:11.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:15:11.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:15:41.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:15:41.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:16:12.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:16:12.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:16:42.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:16:42.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:17:12.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:17:12.342 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:17:42.472 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:17:42.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:18:12.620 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:18:12.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:18:42.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:18:42.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:19:12.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:19:12.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:19:43.057 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:19:43.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:20:13.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:20:13.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:20:43.336 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:20:43.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:21:13.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:21:13.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:21:43.622 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:21:43.631 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:22:13.760 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:22:13.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:22:43.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:22:43.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:23:14.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:23:14.040 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:23:44.162 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:23:44.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:24:14.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:24:14.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:24:44.456 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:24:44.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:25:14.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:25:14.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:25:44.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:25:44.744 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:26:14.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:26:14.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:26:44.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:26:45.007 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:27:15.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:27:15.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:27:45.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:27:45.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:28:15.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:28:15.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:28:45.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:28:45.586 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:29:15.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:29:15.725 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:29:45.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:29:45.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:30:16.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:30:16.039 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:30:46.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:30:46.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:31:16.340 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:31:16.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:31:46.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:31:46.488 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:32:16.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:32:16.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:32:46.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:32:46.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:33:16.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:33:16.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:33:47.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:33:47.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:34:17.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:34:17.183 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:34:47.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:34:47.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:35:17.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:35:17.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:35:47.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:35:47.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:36:17.814 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:36:17.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:36:47.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:36:47.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:37:18.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:37:18.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:37:48.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:37:48.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:38:18.346 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:38:18.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:38:48.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:38:48.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:39:18.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:39:18.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:39:48.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:39:48.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:40:18.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:40:18.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:40:49.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:40:49.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:41:19.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:41:19.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:41:49.304 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:41:49.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:42:19.434 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:42:19.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:42:49.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:42:49.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:43:19.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:43:19.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:43:49.836 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:43:49.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:44:19.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:44:19.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:44:50.106 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:44:50.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:45:20.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:45:20.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:45:50.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:45:50.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:46:20.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:46:20.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:46:50.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:46:50.688 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:47:20.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:47:20.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:47:50.949 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:47:50.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:48:21.089 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:48:21.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:48:51.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:48:51.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:49:21.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:49:21.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:49:51.506 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:49:51.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:50:21.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:50:21.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:50:51.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:50:51.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:51:21.924 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:51:21.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:51:52.062 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:51:52.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:52:22.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:52:22.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:52:52.365 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:52:52.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:53:22.504 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:53:22.513 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:53:52.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:53:52.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:54:22.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:54:22.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:54:52.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:54:52.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:55:23.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:55:23.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:55:53.210 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:55:53.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:56:23.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:56:23.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:56:53.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:56:53.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:57:23.700 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:57:23.708 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:57:53.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:57:53.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:58:23.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:58:23.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:58:54.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:58:54.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:59:24.242 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:59:24.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:59:54.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T01:59:54.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:00:24.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:00:24.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:00:54.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:00:54.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:01:24.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:01:24.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:01:54.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:01:54.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:02:25.076 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:02:25.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:02:55.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:02:55.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:03:25.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:03:25.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:03:55.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:03:55.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:04:25.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:04:25.625 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:04:55.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:04:55.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:05:25.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:05:25.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:05:56.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:05:56.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:06:26.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:06:26.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:06:56.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:06:56.307 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:07:26.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:07:26.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:07:56.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:07:56.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:08:26.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:08:26.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:08:56.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:08:56.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:09:27.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:09:27.032 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:09:57.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:09:57.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:10:27.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:10:27.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:10:57.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:10:57.469 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:11:27.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:11:27.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:11:57.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:11:57.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:12:27.893 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:12:27.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:12:58.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:12:58.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:13:28.171 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:13:28.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:13:58.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:13:58.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:14:28.458 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:14:28.467 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:14:58.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:14:58.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:15:28.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:15:28.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:15:58.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:15:58.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:16:29.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:16:29.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:16:59.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:16:59.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:17:29.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:17:29.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:17:59.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:17:59.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:18:29.566 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:18:29.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:18:59.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:18:59.723 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:19:29.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:19:29.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:19:59.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:20:00.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:20:30.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:20:30.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:21:00.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:21:00.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:21:30.434 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:21:30.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:22:00.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:22:00.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:22:30.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:22:30.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:23:00.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:23:00.862 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:23:30.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:23:31.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:24:01.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:24:01.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:24:31.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:24:31.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:25:01.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:25:01.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:25:31.566 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:25:31.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:26:01.703 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:26:01.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:26:31.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:26:31.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:27:01.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:27:01.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:27:32.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:27:32.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:28:02.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:28:02.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:28:32.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:28:32.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:29:02.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:29:02.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:29:32.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:29:32.710 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:30:02.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:30:02.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:30:32.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:30:32.983 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:31:03.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:31:03.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:31:33.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:31:33.261 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:32:03.391 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:32:03.400 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:32:33.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:32:33.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:33:03.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:33:03.688 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:33:33.817 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:33:33.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:34:03.948 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:34:03.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:34:34.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:34:34.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:35:04.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:35:04.243 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:35:34.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:35:34.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:36:04.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:36:04.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:36:34.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:36:34.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:36:34.997 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-27T02:37:04.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:37:04.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:37:34.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:37:34.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:37:34.998 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-04-27T02:38:05.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:38:05.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:38:34.998 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-04-27T02:38:34.999 INFO:tasks.workunit:Stopping ['fs/test_python.sh'] on client.0... 2024-04-27T02:38:34.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-27T02:38:35.259 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:38:35.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:38:36.080 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/test_python.sh) on smithi016 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 2024-04-27T02:38:36.287 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7a2a4869081c4874878ddb02649ac390 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/test_python.sh) on smithi016 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh' 2024-04-27T02:38:36.290 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-27T02:38:36.338 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-27T02:38:36.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-27T02:38:36.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.588+0000 7fa000a00640 1 Processor -- start 2024-04-27T02:38:36.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.588+0000 7fa000a00640 1 -- start start 2024-04-27T02:38:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7fa000a00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9ffc0b37a0 0x7f9ffc0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7fa000a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ffc140220 0x7f9ffc1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7fa000a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc06e710 con 0x7f9ffc06e330 2024-04-27T02:38:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7fa000a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9ffc0b1ec0 con 0x7f9ffc140220 2024-04-27T02:38:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7fa000a00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f9ffc0b63d0 con 0x7f9ffc0b37a0 2024-04-27T02:38:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7f9ffa800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ffc140220 0x7f9ffc1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:36.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7f9ffa800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ffc140220 0x7f9ffc1406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55042/0 (socket says 172.21.15.16:55042) 2024-04-27T02:38:36.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.590+0000 7f9ffa800640 1 -- 172.21.15.16:0/3239968047 learned_addr learned my addr 172.21.15.16:0/3239968047 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:36.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.591+0000 7f9ff9400640 1 --2- 172.21.15.16:0/3239968047 >> v2:172.21.15.32:3300/0 conn(0x7f9ffc0b37a0 0x7f9ffc0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:36.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.591+0000 7f9ffa800640 1 -- 172.21.15.16:0/3239968047 >> v2:172.21.15.32:3300/0 conn(0x7f9ffc0b37a0 msgr2=0x7f9ffc0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:36.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.591+0000 7f9ffa800640 1 --2- 172.21.15.16:0/3239968047 >> v2:172.21.15.32:3300/0 conn(0x7f9ffc0b37a0 0x7f9ffc0b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.591+0000 7f9ffa800640 1 -- 172.21.15.16:0/3239968047 >> v1:172.21.15.32:6789/0 conn(0x7f9ffc06e330 legacy=0x7f9ffc073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:36.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.591+0000 7f9ffa800640 1 -- 172.21.15.16:0/3239968047 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc0b1870 con 0x7f9ffc140220 2024-04-27T02:38:36.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.591+0000 7f9ff9400640 1 --2- 172.21.15.16:0/3239968047 >> v2:172.21.15.32:3300/0 conn(0x7f9ffc0b37a0 0x7f9ffc0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:36.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.592+0000 7f9ffa800640 1 --2- 172.21.15.16:0/3239968047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc1406b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc147630 tx=0x7f9ff402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c035a131010000d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:36.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.592+0000 7f9ff8a00640 1 -- 172.21.15.16:0/3239968047 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4036070 con 0x7f9ffc140220 2024-04-27T02:38:36.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.592+0000 7f9ff8a00640 1 -- 172.21.15.16:0/3239968047 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4031600 con 0x7f9ffc140220 2024-04-27T02:38:36.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.592+0000 7f9ff8a00640 1 -- 172.21.15.16:0/3239968047 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40319d0 con 0x7f9ffc140220 2024-04-27T02:38:36.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 -- 172.21.15.16:0/3239968047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 msgr2=0x7f9ffc1406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:36.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 --2- 172.21.15.16:0/3239968047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc1406b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc147630 tx=0x7f9ff402a660 comp rx=0 tx=0).stop 2024-04-27T02:38:36.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 -- 172.21.15.16:0/3239968047 shutdown_connections 2024-04-27T02:38:36.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 --2- 172.21.15.16:0/3239968047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc1406b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 --2- 172.21.15.16:0/3239968047 >> v2:172.21.15.32:3300/0 conn(0x7f9ffc0b37a0 0x7f9ffc0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 -- 172.21.15.16:0/3239968047 >> 172.21.15.16:0/3239968047 conn(0x7f9ffc0b6630 msgr2=0x7f9ffc0b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 -- 172.21.15.16:0/3239968047 shutdown_connections 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.593+0000 7fa000a00640 1 -- 172.21.15.16:0/3239968047 wait complete. 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.595+0000 7fa000a00640 1 Processor -- start 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.595+0000 7fa000a00640 1 -- start start 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7fa000a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ffc06e330 0x7f9ffc13e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7fa000a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9ffc0b37a0 0x7f9ffc145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7fa000a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:36.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7fa000a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc150da0 con 0x7f9ffc140220 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7fa000a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc140bf0 con 0x7f9ffc06e330 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7fa000a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc150f20 con 0x7f9ffc0b37a0 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55058/0 (socket says 172.21.15.16:55058) 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 -- 172.21.15.16:0/3695750051 learned_addr learned my addr 172.21.15.16:0/3695750051 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ff9400640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9ffc0b37a0 0x7f9ffc145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ff9e00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ffc06e330 0x7f9ffc13e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:36.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 -- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9ffc0b37a0 msgr2=0x7f9ffc145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9ffc0b37a0 0x7f9ffc145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 -- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ffc06e330 msgr2=0x7f9ffc13e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ffc06e330 0x7f9ffc13e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ffa800640 1 -- 172.21.15.16:0/3695750051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc145350 con 0x7f9ffc140220 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ff9400640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9ffc0b37a0 0x7f9ffc145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.596+0000 7f9ff9e00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ffc06e330 0x7f9ffc13e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.597+0000 7f9ffa800640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc146000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009f40 tx=0x7f9ff4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.597+0000 7f9ff2000640 1 -- 172.21.15.16:0/3695750051 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4036050 con 0x7f9ffc140220 2024-04-27T02:38:36.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.597+0000 7f9ff2000640 1 -- 172.21.15.16:0/3695750051 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4042070 con 0x7f9ffc140220 2024-04-27T02:38:36.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.597+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc072770 con 0x7f9ffc140220 2024-04-27T02:38:36.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.597+0000 7f9ff2000640 1 -- 172.21.15.16:0/3695750051 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4009510 con 0x7f9ffc140220 2024-04-27T02:38:36.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.597+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc072d30 con 0x7f9ffc140220 2024-04-27T02:38:36.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.598+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc0693a0 con 0x7f9ffc140220 2024-04-27T02:38:36.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.599+0000 7f9ff2000640 1 -- 172.21.15.16:0/3695750051 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ff4007bf0 con 0x7f9ffc140220 2024-04-27T02:38:36.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.600+0000 7f9ff2000640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9fdc06c920 0x7f9fdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:36.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.601+0000 7f9ff2000640 1 -- 172.21.15.16:0/3695750051 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f9ff40acb20 con 0x7f9ffc140220 2024-04-27T02:38:36.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.601+0000 7f9ff9e00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9fdc06c920 0x7f9fdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:36.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.602+0000 7f9ff9e00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9fdc06c920 0x7f9fdc06ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9fec003eb0 tx=0x7f9fec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:36.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.606+0000 7f9ff2000640 1 -- 172.21.15.16:0/3695750051 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ff407ae90 con 0x7f9ffc140220 2024-04-27T02:38:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.806+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ffc076600 con 0x7f9fdc06c920 2024-04-27T02:38:36.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.828+0000 7f9ff2000640 1 -- 172.21.15.16:0/3695750051 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7f9fec055840 con 0x7f9fdc06c920 2024-04-27T02:38:36.806 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:38:36.807 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-27T02:38:36.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.834+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9fdc06c920 msgr2=0x7f9fdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:36.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.834+0000 7fa000a00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9fdc06c920 0x7f9fdc06ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9fec003eb0 tx=0x7f9fec009040 comp rx=0 tx=0).stop 2024-04-27T02:38:36.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.834+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 msgr2=0x7f9ffc146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:36.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.834+0000 7fa000a00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc146000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009f40 tx=0x7f9ff4004a40 comp rx=0 tx=0).stop 2024-04-27T02:38:36.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 shutdown_connections 2024-04-27T02:38:36.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f9fdc06c920 0x7f9fdc06ede0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ffc140220 0x7f9ffc146000 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f9ffc0b37a0 0x7f9ffc145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 --2- 172.21.15.16:0/3695750051 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ffc06e330 0x7f9ffc13e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:36.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 >> 172.21.15.16:0/3695750051 conn(0x7f9ffc0b6630 msgr2=0x7f9ffc0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:36.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 shutdown_connections 2024-04-27T02:38:36.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:36.835+0000 7fa000a00640 1 -- 172.21.15.16:0/3695750051 wait complete. 2024-04-27T02:38:36.828 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":5532,"stamp":"2024-04-27T02:38:36.153480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":792815,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":147,"num_read_kb":130,"num_write":329,"num_write_kb":3713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253944,"kb_used_data":3416,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720776,"statfs":{"total":773094113280,"available":772834074624,"internally_reserved":0,"allocated":3497984,"data_stored":2248406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004666"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:43.870953+0000","last_change":"2024-04-26T23:35:33.823180+0000","last_active":"2024-04-27T02:34:43.870953+0000","last_peered":"2024-04-27T02:34:43.870953+0000","last_clean":"2024-04-27T02:34:43.870953+0000","last_became_active":"2024-04-26T23:35:33.822081+0000","last_became_peered":"2024-04-26T23:35:33.822081+0000","last_unstale":"2024-04-27T02:34:43.870953+0000","last_undegraded":"2024-04-27T02:34:43.870953+0000","last_fullsized":"2024-04-27T02:34:43.870953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881829+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-27T02:36:03.881829+0000","last_peered":"2024-04-27T02:36:03.881829+0000","last_clean":"2024-04-27T02:36:03.881829+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-27T02:36:03.881829+0000","last_undegraded":"2024-04-27T02:36:03.881829+0000","last_fullsized":"2024-04-27T02:36:03.881829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"22'1","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881805+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-27T02:36:03.881805+0000","last_peered":"2024-04-27T02:36:03.881805+0000","last_clean":"2024-04-27T02:36:03.881805+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-27T02:36:03.881805+0000","last_undegraded":"2024-04-27T02:36:03.881805+0000","last_fullsized":"2024-04-27T02:36:03.881805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.884759+0000","last_change":"2024-04-26T23:34:46.102692+0000","last_active":"2024-04-27T02:35:18.884759+0000","last_peered":"2024-04-27T02:35:18.884759+0000","last_clean":"2024-04-27T02:35:18.884759+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-27T02:35:18.884759+0000","last_undegraded":"2024-04-27T02:35:18.884759+0000","last_fullsized":"2024-04-27T02:35:18.884759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882951+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-27T02:34:48.882951+0000","last_peered":"2024-04-27T02:34:48.882951+0000","last_clean":"2024-04-27T02:34:48.882951+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-27T02:34:48.882951+0000","last_undegraded":"2024-04-27T02:34:48.882951+0000","last_fullsized":"2024-04-27T02:34:48.882951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.880073+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-27T02:34:48.880073+0000","last_peered":"2024-04-27T02:34:48.880073+0000","last_clean":"2024-04-27T02:34:48.880073+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-27T02:34:48.880073+0000","last_undegraded":"2024-04-27T02:34:48.880073+0000","last_fullsized":"2024-04-27T02:34:48.880073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882868+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-27T02:34:48.882868+0000","last_peered":"2024-04-27T02:34:48.882868+0000","last_clean":"2024-04-27T02:34:48.882868+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-27T02:34:48.882868+0000","last_undegraded":"2024-04-27T02:34:48.882868+0000","last_fullsized":"2024-04-27T02:34:48.882868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.868983+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-27T02:34:48.868983+0000","last_peered":"2024-04-27T02:34:48.868983+0000","last_clean":"2024-04-27T02:34:48.868983+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-27T02:34:48.868983+0000","last_undegraded":"2024-04-27T02:34:48.868983+0000","last_fullsized":"2024-04-27T02:34:48.868983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.169172+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-27T02:34:04.169172+0000","last_peered":"2024-04-27T02:34:04.169172+0000","last_clean":"2024-04-27T02:34:04.169172+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-27T02:34:04.169172+0000","last_undegraded":"2024-04-27T02:34:04.169172+0000","last_fullsized":"2024-04-27T02:34:04.169172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"22'3","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895751+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-27T02:36:03.895751+0000","last_peered":"2024-04-27T02:36:03.895751+0000","last_clean":"2024-04-27T02:36:03.895751+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-27T02:36:03.895751+0000","last_undegraded":"2024-04-27T02:36:03.895751+0000","last_fullsized":"2024-04-27T02:36:03.895751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895708+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-27T02:36:03.895708+0000","last_peered":"2024-04-27T02:36:03.895708+0000","last_clean":"2024-04-27T02:36:03.895708+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-27T02:36:03.895708+0000","last_undegraded":"2024-04-27T02:36:03.895708+0000","last_fullsized":"2024-04-27T02:36:03.895708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895675+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-27T02:36:03.895675+0000","last_peered":"2024-04-27T02:36:03.895675+0000","last_clean":"2024-04-27T02:36:03.895675+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-27T02:36:03.895675+0000","last_undegraded":"2024-04-27T02:36:03.895675+0000","last_fullsized":"2024-04-27T02:36:03.895675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886609+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-27T02:36:03.886609+0000","last_peered":"2024-04-27T02:36:03.886609+0000","last_clean":"2024-04-27T02:36:03.886609+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-27T02:36:03.886609+0000","last_undegraded":"2024-04-27T02:36:03.886609+0000","last_fullsized":"2024-04-27T02:36:03.886609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.876176+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-27T02:34:58.876176+0000","last_peered":"2024-04-27T02:34:58.876176+0000","last_clean":"2024-04-27T02:34:58.876176+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-27T02:34:58.876176+0000","last_undegraded":"2024-04-27T02:34:58.876176+0000","last_fullsized":"2024-04-27T02:34:58.876176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.176263+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-27T02:34:29.176263+0000","last_peered":"2024-04-27T02:34:29.176263+0000","last_clean":"2024-04-27T02:34:29.176263+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-27T02:34:29.176263+0000","last_undegraded":"2024-04-27T02:34:29.176263+0000","last_fullsized":"2024-04-27T02:34:29.176263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187913+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-27T02:34:29.187913+0000","last_peered":"2024-04-27T02:34:29.187913+0000","last_clean":"2024-04-27T02:34:29.187913+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-27T02:34:29.187913+0000","last_undegraded":"2024-04-27T02:34:29.187913+0000","last_fullsized":"2024-04-27T02:34:29.187913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.188052+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-27T02:34:29.188052+0000","last_peered":"2024-04-27T02:34:29.188052+0000","last_clean":"2024-04-27T02:34:29.188052+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-27T02:34:29.188052+0000","last_undegraded":"2024-04-27T02:34:29.188052+0000","last_fullsized":"2024-04-27T02:34:29.188052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:37.828024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158366+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-27T02:34:29.158366+0000","last_peered":"2024-04-27T02:34:29.158366+0000","last_clean":"2024-04-27T02:34:29.158366+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-27T02:34:29.158366+0000","last_undegraded":"2024-04-27T02:34:29.158366+0000","last_fullsized":"2024-04-27T02:34:29.158366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.889371+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-27T02:35:18.889371+0000","last_peered":"2024-04-27T02:35:18.889371+0000","last_clean":"2024-04-27T02:35:18.889371+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-27T02:35:18.889371+0000","last_undegraded":"2024-04-27T02:35:18.889371+0000","last_fullsized":"2024-04-27T02:35:18.889371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:09.342327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"22'1","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882992+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-27T02:34:48.882992+0000","last_peered":"2024-04-27T02:34:48.882992+0000","last_clean":"2024-04-27T02:34:48.882992+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-27T02:34:48.882992+0000","last_undegraded":"2024-04-27T02:34:48.882992+0000","last_fullsized":"2024-04-27T02:34:48.882992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"22'3","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877811+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-27T02:34:48.877811+0000","last_peered":"2024-04-27T02:34:48.877811+0000","last_clean":"2024-04-27T02:34:48.877811+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-27T02:34:48.877811+0000","last_undegraded":"2024-04-27T02:34:48.877811+0000","last_fullsized":"2024-04-27T02:34:48.877811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"22'1","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877782+0000","last_change":"2024-04-26T23:34:46.096164+0000","last_active":"2024-04-27T02:34:48.877782+0000","last_peered":"2024-04-27T02:34:48.877782+0000","last_clean":"2024-04-27T02:34:48.877782+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-27T02:34:48.877782+0000","last_undegraded":"2024-04-27T02:34:48.877782+0000","last_fullsized":"2024-04-27T02:34:48.877782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869060+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-27T02:34:48.869060+0000","last_peered":"2024-04-27T02:34:48.869060+0000","last_clean":"2024-04-27T02:34:48.869060+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-27T02:34:48.869060+0000","last_undegraded":"2024-04-27T02:34:48.869060+0000","last_fullsized":"2024-04-27T02:34:48.869060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"22'5","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.887661+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-27T02:35:08.887661+0000","last_peered":"2024-04-27T02:35:08.887661+0000","last_clean":"2024-04-27T02:35:08.887661+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-27T02:35:08.887661+0000","last_undegraded":"2024-04-27T02:35:08.887661+0000","last_fullsized":"2024-04-27T02:35:08.887661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.867416+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-27T02:34:38.867416+0000","last_peered":"2024-04-27T02:34:38.867416+0000","last_clean":"2024-04-27T02:34:38.867416+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-27T02:34:38.867416+0000","last_undegraded":"2024-04-27T02:34:38.867416+0000","last_fullsized":"2024-04-27T02:34:38.867416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.878566+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-27T02:34:38.878566+0000","last_peered":"2024-04-27T02:34:38.878566+0000","last_clean":"2024-04-27T02:34:38.878566+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-27T02:34:38.878566+0000","last_undegraded":"2024-04-27T02:34:38.878566+0000","last_fullsized":"2024-04-27T02:34:38.878566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873079+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-27T02:34:38.873079+0000","last_peered":"2024-04-27T02:34:38.873079+0000","last_clean":"2024-04-27T02:34:38.873079+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-27T02:34:38.873079+0000","last_undegraded":"2024-04-27T02:34:38.873079+0000","last_fullsized":"2024-04-27T02:34:38.873079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873013+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-27T02:34:38.873013+0000","last_peered":"2024-04-27T02:34:38.873013+0000","last_clean":"2024-04-27T02:34:38.873013+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-27T02:34:38.873013+0000","last_undegraded":"2024-04-27T02:34:38.873013+0000","last_fullsized":"2024-04-27T02:34:38.873013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.175396+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-27T02:34:24.175396+0000","last_peered":"2024-04-27T02:34:24.175396+0000","last_clean":"2024-04-27T02:34:24.175396+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-27T02:34:24.175396+0000","last_undegraded":"2024-04-27T02:34:24.175396+0000","last_fullsized":"2024-04-27T02:34:24.175396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:54.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896455+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-27T02:36:03.896455+0000","last_peered":"2024-04-27T02:36:03.896455+0000","last_clean":"2024-04-27T02:36:03.896455+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-27T02:36:03.896455+0000","last_undegraded":"2024-04-27T02:36:03.896455+0000","last_fullsized":"2024-04-27T02:36:03.896455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:08.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882856+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-27T02:36:03.882856+0000","last_peered":"2024-04-27T02:36:03.882856+0000","last_clean":"2024-04-27T02:36:03.882856+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-27T02:36:03.882856+0000","last_undegraded":"2024-04-27T02:36:03.882856+0000","last_fullsized":"2024-04-27T02:36:03.882856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.891627+0000","last_change":"2024-04-26T23:34:46.098997+0000","last_active":"2024-04-27T02:36:03.891627+0000","last_peered":"2024-04-27T02:36:03.891627+0000","last_clean":"2024-04-27T02:36:03.891627+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-27T02:36:03.891627+0000","last_undegraded":"2024-04-27T02:36:03.891627+0000","last_fullsized":"2024-04-27T02:36:03.891627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877841+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-27T02:34:48.877841+0000","last_peered":"2024-04-27T02:34:48.877841+0000","last_clean":"2024-04-27T02:34:48.877841+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-27T02:34:48.877841+0000","last_undegraded":"2024-04-27T02:34:48.877841+0000","last_fullsized":"2024-04-27T02:34:48.877841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869110+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-27T02:34:48.869110+0000","last_peered":"2024-04-27T02:34:48.869110+0000","last_clean":"2024-04-27T02:34:48.869110+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-27T02:34:48.869110+0000","last_undegraded":"2024-04-27T02:34:48.869110+0000","last_fullsized":"2024-04-27T02:34:48.869110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877875+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-27T02:34:48.877875+0000","last_peered":"2024-04-27T02:34:48.877875+0000","last_clean":"2024-04-27T02:34:48.877875+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-27T02:34:48.877875+0000","last_undegraded":"2024-04-27T02:34:48.877875+0000","last_fullsized":"2024-04-27T02:34:48.877875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884228+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-27T02:34:48.884228+0000","last_peered":"2024-04-27T02:34:48.884228+0000","last_clean":"2024-04-27T02:34:48.884228+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-27T02:34:48.884228+0000","last_undegraded":"2024-04-27T02:34:48.884228+0000","last_fullsized":"2024-04-27T02:34:48.884228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.166242+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-27T02:34:04.166242+0000","last_peered":"2024-04-27T02:34:04.166242+0000","last_clean":"2024-04-27T02:34:04.166242+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-27T02:34:04.166242+0000","last_undegraded":"2024-04-27T02:34:04.166242+0000","last_fullsized":"2024-04-27T02:34:04.166242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881735+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-27T02:36:03.881735+0000","last_peered":"2024-04-27T02:36:03.881735+0000","last_clean":"2024-04-27T02:36:03.881735+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-27T02:36:03.881735+0000","last_undegraded":"2024-04-27T02:36:03.881735+0000","last_fullsized":"2024-04-27T02:36:03.881735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896414+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-27T02:36:03.896414+0000","last_peered":"2024-04-27T02:36:03.896414+0000","last_clean":"2024-04-27T02:36:03.896414+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-27T02:36:03.896414+0000","last_undegraded":"2024-04-27T02:36:03.896414+0000","last_fullsized":"2024-04-27T02:36:03.896414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.165505+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-27T02:34:04.165505+0000","last_peered":"2024-04-27T02:34:04.165505+0000","last_clean":"2024-04-27T02:34:04.165505+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-27T02:34:04.165505+0000","last_undegraded":"2024-04-27T02:34:04.165505+0000","last_fullsized":"2024-04-27T02:34:04.165505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889946+0000","last_change":"2024-04-26T23:34:45.074623+0000","last_active":"2024-04-27T02:36:03.889946+0000","last_peered":"2024-04-27T02:36:03.889946+0000","last_clean":"2024-04-27T02:36:03.889946+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-27T02:36:03.889946+0000","last_undegraded":"2024-04-27T02:36:03.889946+0000","last_fullsized":"2024-04-27T02:36:03.889946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.891680+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-27T02:36:03.891680+0000","last_peered":"2024-04-27T02:36:03.891680+0000","last_clean":"2024-04-27T02:36:03.891680+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-27T02:36:03.891680+0000","last_undegraded":"2024-04-27T02:36:03.891680+0000","last_fullsized":"2024-04-27T02:36:03.891680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895771+0000","last_change":"2024-04-26T23:34:45.073763+0000","last_active":"2024-04-27T02:36:03.895771+0000","last_peered":"2024-04-27T02:36:03.895771+0000","last_clean":"2024-04-27T02:36:03.895771+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-27T02:36:03.895771+0000","last_undegraded":"2024-04-27T02:36:03.895771+0000","last_fullsized":"2024-04-27T02:36:03.895771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:07.508274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881878+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-27T02:36:03.881878+0000","last_peered":"2024-04-27T02:36:03.881878+0000","last_clean":"2024-04-27T02:36:03.881878+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-27T02:36:03.881878+0000","last_undegraded":"2024-04-27T02:36:03.881878+0000","last_fullsized":"2024-04-27T02:36:03.881878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882929+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-27T02:36:03.882929+0000","last_peered":"2024-04-27T02:36:03.882929+0000","last_clean":"2024-04-27T02:36:03.882929+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-27T02:36:03.882929+0000","last_undegraded":"2024-04-27T02:36:03.882929+0000","last_fullsized":"2024-04-27T02:36:03.882929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.886165+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-27T02:34:58.886165+0000","last_peered":"2024-04-27T02:34:58.886165+0000","last_clean":"2024-04-27T02:34:58.886165+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-27T02:34:58.886165+0000","last_undegraded":"2024-04-27T02:34:58.886165+0000","last_fullsized":"2024-04-27T02:34:58.886165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:03.761817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'55","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.881588+0000","last_change":"2024-04-26T23:34:45.074276+0000","last_active":"2024-04-27T02:34:58.881588+0000","last_peered":"2024-04-27T02:34:58.881588+0000","last_clean":"2024-04-27T02:34:58.881588+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-27T02:34:58.881588+0000","last_undegraded":"2024-04-27T02:34:58.881588+0000","last_fullsized":"2024-04-27T02:34:58.881588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:33.430917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199217,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895730+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-27T02:36:03.895730+0000","last_peered":"2024-04-27T02:36:03.895730+0000","last_clean":"2024-04-27T02:36:03.895730+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-27T02:36:03.895730+0000","last_undegraded":"2024-04-27T02:36:03.895730+0000","last_fullsized":"2024-04-27T02:36:03.895730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158273+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-27T02:34:29.158273+0000","last_peered":"2024-04-27T02:34:29.158273+0000","last_clean":"2024-04-27T02:34:29.158273+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-27T02:34:29.158273+0000","last_undegraded":"2024-04-27T02:34:29.158273+0000","last_fullsized":"2024-04-27T02:34:29.158273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.170403+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-27T02:34:29.170403+0000","last_peered":"2024-04-27T02:34:29.170403+0000","last_clean":"2024-04-27T02:34:29.170403+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-27T02:34:29.170403+0000","last_undegraded":"2024-04-27T02:34:29.170403+0000","last_fullsized":"2024-04-27T02:34:29.170403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187994+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-27T02:34:29.187994+0000","last_peered":"2024-04-27T02:34:29.187994+0000","last_clean":"2024-04-27T02:34:29.187994+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-27T02:34:29.187994+0000","last_undegraded":"2024-04-27T02:34:29.187994+0000","last_fullsized":"2024-04-27T02:34:29.187994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:49.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.188014+0000","last_change":"2024-04-26T23:34:46.093800+0000","last_active":"2024-04-27T02:34:29.188014+0000","last_peered":"2024-04-27T02:34:29.188014+0000","last_clean":"2024-04-27T02:34:29.188014+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-27T02:34:29.188014+0000","last_undegraded":"2024-04-27T02:34:29.188014+0000","last_fullsized":"2024-04-27T02:34:29.188014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:07.701378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.186924+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-27T02:34:29.186924+0000","last_peered":"2024-04-27T02:34:29.186924+0000","last_clean":"2024-04-27T02:34:29.186924+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-27T02:34:29.186924+0000","last_undegraded":"2024-04-27T02:34:29.186924+0000","last_fullsized":"2024-04-27T02:34:29.186924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.173518+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-27T02:34:29.173518+0000","last_peered":"2024-04-27T02:34:29.173518+0000","last_clean":"2024-04-27T02:34:29.173518+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-27T02:34:29.173518+0000","last_undegraded":"2024-04-27T02:34:29.173518+0000","last_fullsized":"2024-04-27T02:34:29.173518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:08.523129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.169460+0000","last_change":"2024-04-26T23:34:45.072379+0000","last_active":"2024-04-27T02:34:29.169460+0000","last_peered":"2024-04-27T02:34:29.169460+0000","last_clean":"2024-04-27T02:34:29.169460+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-27T02:34:29.169460+0000","last_undegraded":"2024-04-27T02:34:29.169460+0000","last_fullsized":"2024-04-27T02:34:29.169460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187961+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-27T02:34:29.187961+0000","last_peered":"2024-04-27T02:34:29.187961+0000","last_clean":"2024-04-27T02:34:29.187961+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-27T02:34:29.187961+0000","last_undegraded":"2024-04-27T02:34:29.187961+0000","last_fullsized":"2024-04-27T02:34:29.187961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.888296+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-27T02:35:18.888296+0000","last_peered":"2024-04-27T02:35:18.888296+0000","last_clean":"2024-04-27T02:35:18.888296+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-27T02:35:18.888296+0000","last_undegraded":"2024-04-27T02:35:18.888296+0000","last_fullsized":"2024-04-27T02:35:18.888296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.880158+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-27T02:34:48.880158+0000","last_peered":"2024-04-27T02:34:48.880158+0000","last_clean":"2024-04-27T02:34:48.880158+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-27T02:34:48.880158+0000","last_undegraded":"2024-04-27T02:34:48.880158+0000","last_fullsized":"2024-04-27T02:34:48.880158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877924+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-27T02:34:48.877924+0000","last_peered":"2024-04-27T02:34:48.877924+0000","last_clean":"2024-04-27T02:34:48.877924+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-27T02:34:48.877924+0000","last_undegraded":"2024-04-27T02:34:48.877924+0000","last_fullsized":"2024-04-27T02:34:48.877924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.888247+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-27T02:35:18.888247+0000","last_peered":"2024-04-27T02:35:18.888247+0000","last_clean":"2024-04-27T02:35:18.888247+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-27T02:35:18.888247+0000","last_undegraded":"2024-04-27T02:35:18.888247+0000","last_fullsized":"2024-04-27T02:35:18.888247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869159+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-27T02:34:48.869159+0000","last_peered":"2024-04-27T02:34:48.869159+0000","last_clean":"2024-04-27T02:34:48.869159+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-27T02:34:48.869159+0000","last_undegraded":"2024-04-27T02:34:48.869159+0000","last_fullsized":"2024-04-27T02:34:48.869159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883029+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-27T02:34:48.883029+0000","last_peered":"2024-04-27T02:34:48.883029+0000","last_clean":"2024-04-27T02:34:48.883029+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-27T02:34:48.883029+0000","last_undegraded":"2024-04-27T02:34:48.883029+0000","last_fullsized":"2024-04-27T02:34:48.883029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.874659+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-27T02:34:48.874659+0000","last_peered":"2024-04-27T02:34:48.874659+0000","last_clean":"2024-04-27T02:34:48.874659+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-27T02:34:48.874659+0000","last_undegraded":"2024-04-27T02:34:48.874659+0000","last_fullsized":"2024-04-27T02:34:48.874659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884327+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-27T02:34:48.884327+0000","last_peered":"2024-04-27T02:34:48.884327+0000","last_clean":"2024-04-27T02:34:48.884327+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-27T02:34:48.884327+0000","last_undegraded":"2024-04-27T02:34:48.884327+0000","last_fullsized":"2024-04-27T02:34:48.884327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:10.277157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'161","reported_seq":318,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:13.881887+0000","last_change":"2024-04-26T23:34:41.212862+0000","last_active":"2024-04-27T02:35:13.881887+0000","last_peered":"2024-04-27T02:35:13.881887+0000","last_clean":"2024-04-27T02:35:13.881887+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-27T02:35:13.881887+0000","last_undegraded":"2024-04-27T02:35:13.881887+0000","last_fullsized":"2024-04-27T02:35:13.881887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_clean_scrub_stamp":"2024-04-26T23:34:39.876770+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:44.232023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896518+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-27T02:36:03.896518+0000","last_peered":"2024-04-27T02:36:03.896518+0000","last_clean":"2024-04-27T02:36:03.896518+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-27T02:36:03.896518+0000","last_undegraded":"2024-04-27T02:36:03.896518+0000","last_fullsized":"2024-04-27T02:36:03.896518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:35.809938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889767+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-27T02:36:03.889767+0000","last_peered":"2024-04-27T02:36:03.889767+0000","last_clean":"2024-04-27T02:36:03.889767+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-27T02:36:03.889767+0000","last_undegraded":"2024-04-27T02:36:03.889767+0000","last_fullsized":"2024-04-27T02:36:03.889767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.889297+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-27T02:35:18.889297+0000","last_peered":"2024-04-27T02:35:18.889297+0000","last_clean":"2024-04-27T02:35:18.889297+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-27T02:35:18.889297+0000","last_undegraded":"2024-04-27T02:35:18.889297+0000","last_fullsized":"2024-04-27T02:35:18.889297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886561+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-27T02:36:03.886561+0000","last_peered":"2024-04-27T02:36:03.886561+0000","last_clean":"2024-04-27T02:36:03.886561+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-27T02:36:03.886561+0000","last_undegraded":"2024-04-27T02:36:03.886561+0000","last_fullsized":"2024-04-27T02:36:03.886561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882893+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-27T02:36:03.882893+0000","last_peered":"2024-04-27T02:36:03.882893+0000","last_clean":"2024-04-27T02:36:03.882893+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-27T02:36:03.882893+0000","last_undegraded":"2024-04-27T02:36:03.882893+0000","last_fullsized":"2024-04-27T02:36:03.882893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":1,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"22'2","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874268+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-27T02:35:18.874268+0000","last_peered":"2024-04-27T02:35:18.874268+0000","last_clean":"2024-04-27T02:35:18.874268+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-27T02:35:18.874268+0000","last_undegraded":"2024-04-27T02:35:18.874268+0000","last_fullsized":"2024-04-27T02:35:18.874268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896490+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-27T02:36:03.896490+0000","last_peered":"2024-04-27T02:36:03.896490+0000","last_clean":"2024-04-27T02:36:03.896490+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-27T02:36:03.896490+0000","last_undegraded":"2024-04-27T02:36:03.896490+0000","last_fullsized":"2024-04-27T02:36:03.896490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:21.723421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895639+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-27T02:36:03.895639+0000","last_peered":"2024-04-27T02:36:03.895639+0000","last_clean":"2024-04-27T02:36:03.895639+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-27T02:36:03.895639+0000","last_undegraded":"2024-04-27T02:36:03.895639+0000","last_fullsized":"2024-04-27T02:36:03.895639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881786+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-27T02:36:03.881786+0000","last_peered":"2024-04-27T02:36:03.881786+0000","last_clean":"2024-04-27T02:36:03.881786+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-27T02:36:03.881786+0000","last_undegraded":"2024-04-27T02:36:03.881786+0000","last_fullsized":"2024-04-27T02:36:03.881786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'3","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.171989+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-27T02:34:24.171989+0000","last_peered":"2024-04-27T02:34:24.171989+0000","last_clean":"2024-04-27T02:34:24.171989+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-27T02:34:24.171989+0000","last_undegraded":"2024-04-27T02:34:24.171989+0000","last_fullsized":"2024-04-27T02:34:24.171989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.186989+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-27T02:34:24.186989+0000","last_peered":"2024-04-27T02:34:24.186989+0000","last_clean":"2024-04-27T02:34:24.186989+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-27T02:34:24.186989+0000","last_undegraded":"2024-04-27T02:34:24.186989+0000","last_fullsized":"2024-04-27T02:34:24.186989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:33.819205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886639+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-27T02:36:03.886639+0000","last_peered":"2024-04-27T02:36:03.886639+0000","last_clean":"2024-04-27T02:36:03.886639+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-27T02:36:03.886639+0000","last_undegraded":"2024-04-27T02:36:03.886639+0000","last_fullsized":"2024-04-27T02:36:03.886639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'5","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.876020+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-27T02:34:38.876020+0000","last_peered":"2024-04-27T02:34:38.876020+0000","last_clean":"2024-04-27T02:34:38.876020+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-27T02:34:38.876020+0000","last_undegraded":"2024-04-27T02:34:38.876020+0000","last_fullsized":"2024-04-27T02:34:38.876020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'4","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.876040+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-27T02:34:38.876040+0000","last_peered":"2024-04-27T02:34:38.876040+0000","last_clean":"2024-04-27T02:34:38.876040+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-27T02:34:38.876040+0000","last_undegraded":"2024-04-27T02:34:38.876040+0000","last_fullsized":"2024-04-27T02:34:38.876040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'3","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.882669+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-27T02:34:38.882669+0000","last_peered":"2024-04-27T02:34:38.882669+0000","last_clean":"2024-04-27T02:34:38.882669+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-27T02:34:38.882669+0000","last_undegraded":"2024-04-27T02:34:38.882669+0000","last_fullsized":"2024-04-27T02:34:38.882669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:19.687355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875998+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-27T02:34:38.875998+0000","last_peered":"2024-04-27T02:34:38.875998+0000","last_clean":"2024-04-27T02:34:38.875998+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-27T02:34:38.875998+0000","last_undegraded":"2024-04-27T02:34:38.875998+0000","last_fullsized":"2024-04-27T02:34:38.875998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.881192+0000","last_change":"2024-04-26T23:34:45.076058+0000","last_active":"2024-04-27T02:34:38.881192+0000","last_peered":"2024-04-27T02:34:38.881192+0000","last_clean":"2024-04-27T02:34:38.881192+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-27T02:34:38.881192+0000","last_undegraded":"2024-04-27T02:34:38.881192+0000","last_fullsized":"2024-04-27T02:34:38.881192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.882474+0000","last_change":"2024-04-26T23:34:46.092601+0000","last_active":"2024-04-27T02:34:38.882474+0000","last_peered":"2024-04-27T02:34:38.882474+0000","last_clean":"2024-04-27T02:34:38.882474+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-27T02:34:38.882474+0000","last_undegraded":"2024-04-27T02:34:38.882474+0000","last_fullsized":"2024-04-27T02:34:38.882474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:01.319097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875932+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-27T02:34:38.875932+0000","last_peered":"2024-04-27T02:34:38.875932+0000","last_clean":"2024-04-27T02:34:38.875932+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-27T02:34:38.875932+0000","last_undegraded":"2024-04-27T02:34:38.875932+0000","last_fullsized":"2024-04-27T02:34:38.875932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875867+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-27T02:34:38.875867+0000","last_peered":"2024-04-27T02:34:38.875867+0000","last_clean":"2024-04-27T02:34:38.875867+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-27T02:34:38.875867+0000","last_undegraded":"2024-04-27T02:34:38.875867+0000","last_fullsized":"2024-04-27T02:34:38.875867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.877678+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-27T02:35:08.877678+0000","last_peered":"2024-04-27T02:35:08.877678+0000","last_clean":"2024-04-27T02:35:08.877678+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-27T02:35:08.877678+0000","last_undegraded":"2024-04-27T02:35:08.877678+0000","last_fullsized":"2024-04-27T02:35:08.877678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.871792+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-27T02:34:48.871792+0000","last_peered":"2024-04-27T02:34:48.871792+0000","last_clean":"2024-04-27T02:34:48.871792+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-27T02:34:48.871792+0000","last_undegraded":"2024-04-27T02:34:48.871792+0000","last_fullsized":"2024-04-27T02:34:48.871792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884278+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-27T02:34:48.884278+0000","last_peered":"2024-04-27T02:34:48.884278+0000","last_clean":"2024-04-27T02:34:48.884278+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-27T02:34:48.884278+0000","last_undegraded":"2024-04-27T02:34:48.884278+0000","last_fullsized":"2024-04-27T02:34:48.884278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:35.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.887716+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-27T02:35:08.887716+0000","last_peered":"2024-04-27T02:35:08.887716+0000","last_clean":"2024-04-27T02:35:08.887716+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-27T02:35:08.887716+0000","last_undegraded":"2024-04-27T02:35:08.887716+0000","last_fullsized":"2024-04-27T02:35:08.887716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:37.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884310+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-27T02:34:48.884310+0000","last_peered":"2024-04-27T02:34:48.884310+0000","last_clean":"2024-04-27T02:34:48.884310+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-27T02:34:48.884310+0000","last_undegraded":"2024-04-27T02:34:48.884310+0000","last_fullsized":"2024-04-27T02:34:48.884310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883060+0000","last_change":"2024-04-26T23:34:45.075234+0000","last_active":"2024-04-27T02:34:48.883060+0000","last_peered":"2024-04-27T02:34:48.883060+0000","last_clean":"2024-04-27T02:34:48.883060+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-27T02:34:48.883060+0000","last_undegraded":"2024-04-27T02:34:48.883060+0000","last_fullsized":"2024-04-27T02:34:48.883060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877876+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-27T02:34:48.877876+0000","last_peered":"2024-04-27T02:34:48.877876+0000","last_clean":"2024-04-27T02:34:48.877876+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-27T02:34:48.877876+0000","last_undegraded":"2024-04-27T02:34:48.877876+0000","last_fullsized":"2024-04-27T02:34:48.877876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883144+0000","last_change":"2024-04-26T23:34:45.074596+0000","last_active":"2024-04-27T02:34:48.883144+0000","last_peered":"2024-04-27T02:34:48.883144+0000","last_clean":"2024-04-27T02:34:48.883144+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-27T02:34:48.883144+0000","last_undegraded":"2024-04-27T02:34:48.883144+0000","last_fullsized":"2024-04-27T02:34:48.883144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881855+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-27T02:36:03.881855+0000","last_peered":"2024-04-27T02:36:03.881855+0000","last_clean":"2024-04-27T02:36:03.881855+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-27T02:36:03.881855+0000","last_undegraded":"2024-04-27T02:36:03.881855+0000","last_fullsized":"2024-04-27T02:36:03.881855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874398+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-27T02:35:18.874398+0000","last_peered":"2024-04-27T02:35:18.874398+0000","last_clean":"2024-04-27T02:35:18.874398+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-27T02:35:18.874398+0000","last_undegraded":"2024-04-27T02:35:18.874398+0000","last_fullsized":"2024-04-27T02:35:18.874398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874378+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-27T02:35:18.874378+0000","last_peered":"2024-04-27T02:35:18.874378+0000","last_clean":"2024-04-27T02:35:18.874378+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-27T02:35:18.874378+0000","last_undegraded":"2024-04-27T02:35:18.874378+0000","last_fullsized":"2024-04-27T02:35:18.874378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889818+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-27T02:36:03.889818+0000","last_peered":"2024-04-27T02:36:03.889818+0000","last_clean":"2024-04-27T02:36:03.889818+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-27T02:36:03.889818+0000","last_undegraded":"2024-04-27T02:36:03.889818+0000","last_fullsized":"2024-04-27T02:36:03.889818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":202439,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":102,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":404878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834577058,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":85395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834577057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":229376,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834577057,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":839680,"data_stored":675739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834577057,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":446464,"data_stored":282736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834577057,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":83437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834577057,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":438272,"data_stored":282064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834577057,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":827392,"data_stored":673285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834577057,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":199217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-27T02:38:36.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-27T02:38:37.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.113+0000 7f0a07e00640 1 Processor -- start 2024-04-27T02:38:37.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.114+0000 7f0a07e00640 1 -- start start 2024-04-27T02:38:37.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a07e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a080b6a90 0x7f0a080b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a07e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0a080afbd0 0x7f0a0814b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a07e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080b6e70 con 0x7f0a080b3cc0 2024-04-27T02:38:37.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a07e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0a08142a80 con 0x7f0a080b6a90 2024-04-27T02:38:37.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a07e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f0a080b5b00 con 0x7f0a080afbd0 2024-04-27T02:38:37.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a06a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a080b6a90 0x7f0a080b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a06a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a080b6a90 0x7f0a080b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38490/0 (socket says 172.21.15.16:38490) 2024-04-27T02:38:37.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.115+0000 7f0a06a00640 1 -- 172.21.15.16:0/1174383253 learned_addr learned my addr 172.21.15.16:0/1174383253 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:37.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.116+0000 7f0a06a00640 1 -- 172.21.15.16:0/1174383253 >> v2:172.21.15.32:3300/0 conn(0x7f0a080afbd0 msgr2=0x7f0a0814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:37.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.116+0000 7f0a06a00640 1 --2- 172.21.15.16:0/1174383253 >> v2:172.21.15.32:3300/0 conn(0x7f0a080afbd0 0x7f0a0814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.116+0000 7f0a06a00640 1 -- 172.21.15.16:0/1174383253 >> v1:172.21.15.32:6789/0 conn(0x7f0a080b3cc0 legacy=0x7f0a081482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:37.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.116+0000 7f0a06a00640 1 -- 172.21.15.16:0/1174383253 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a080b5d50 con 0x7f0a080b6a90 2024-04-27T02:38:37.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.117+0000 7f0a06a00640 1 --2- 172.21.15.16:0/1174383253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b6a90 0x7f0a080b3780 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a0806ea30 tx=0x7f09f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4092b2d03be968f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:37.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.117+0000 7f0a06000640 1 -- 172.21.15.16:0/1174383253 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8037070 con 0x7f0a080b6a90 2024-04-27T02:38:37.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.117+0000 7f0a06000640 1 -- 172.21.15.16:0/1174383253 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f802ae20 con 0x7f0a080b6a90 2024-04-27T02:38:37.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.117+0000 7f0a06000640 1 -- 172.21.15.16:0/1174383253 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8032660 con 0x7f0a080b6a90 2024-04-27T02:38:37.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.117+0000 7f0a07e00640 1 -- 172.21.15.16:0/1174383253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b6a90 msgr2=0x7f0a080b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.117+0000 7f0a07e00640 1 --2- 172.21.15.16:0/1174383253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b6a90 0x7f0a080b3780 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a0806ea30 tx=0x7f09f802a110 comp rx=0 tx=0).stop 2024-04-27T02:38:37.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.118+0000 7f0a07e00640 1 -- 172.21.15.16:0/1174383253 shutdown_connections 2024-04-27T02:38:37.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.118+0000 7f0a07e00640 1 --2- 172.21.15.16:0/1174383253 >> v2:172.21.15.32:3300/0 conn(0x7f0a080afbd0 0x7f0a0814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.118+0000 7f0a07e00640 1 --2- 172.21.15.16:0/1174383253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b6a90 0x7f0a080b3780 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.118+0000 7f0a07e00640 1 -- 172.21.15.16:0/1174383253 >> 172.21.15.16:0/1174383253 conn(0x7f0a08068270 msgr2=0x7f0a08068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:37.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.118+0000 7f0a07e00640 1 -- 172.21.15.16:0/1174383253 shutdown_connections 2024-04-27T02:38:37.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.118+0000 7f0a07e00640 1 -- 172.21.15.16:0/1174383253 wait complete. 2024-04-27T02:38:37.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.119+0000 7f0a07e00640 1 Processor -- start 2024-04-27T02:38:37.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.119+0000 7f0a07e00640 1 -- start start 2024-04-27T02:38:37.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.120+0000 7f0a07e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0a080afbd0 0x7f0a080b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.120+0000 7f0a07e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b3cc0 0x7f0a08137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.120+0000 7f0a07e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080b6a90 0x7f0a08137f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.120+0000 7f0a07e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0a080ae8a0 con 0x7f0a080b3cc0 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.120+0000 7f0a07e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f0a080b0b50 con 0x7f0a080b6a90 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.120+0000 7f0a07e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f0a08073cb0 con 0x7f0a080afbd0 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.120+0000 7f09fe000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b3cc0 0x7f0a08137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b3cc0 0x7f0a08137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38498/0 (socket says 172.21.15.16:38498) 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 -- 172.21.15.16:0/3714898236 learned_addr learned my addr 172.21.15.16:0/3714898236 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:37.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f0a06a00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0a080afbd0 0x7f0a080b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 -- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0a080afbd0 msgr2=0x7f0a080b9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0a080afbd0 0x7f0a080b9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f0a07400640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080b6a90 0x7f0a08137f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 -- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080b6a90 msgr2=0x7f0a08137f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080b6a90 0x7f0a08137f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 -- 172.21.15.16:0/3714898236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a080b81c0 con 0x7f0a080b3cc0 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.121+0000 7f09fe000640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b3cc0 0x7f0a08137a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b4a0 tx=0x7f09f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:37.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.122+0000 7f09ff400640 1 -- 172.21.15.16:0/3714898236 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0014070 con 0x7f0a080b3cc0 2024-04-27T02:38:37.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.122+0000 7f09ff400640 1 -- 172.21.15.16:0/3714898236 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0010610 con 0x7f0a080b3cc0 2024-04-27T02:38:37.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.122+0000 7f09ff400640 1 -- 172.21.15.16:0/3714898236 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0010a00 con 0x7f0a080b3cc0 2024-04-27T02:38:37.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.122+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a080b9280 con 0x7f0a080b3cc0 2024-04-27T02:38:37.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.122+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a080b16e0 con 0x7f0a080b3cc0 2024-04-27T02:38:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.123+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a08076600 con 0x7f0a080b3cc0 2024-04-27T02:38:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.124+0000 7f09ff400640 1 -- 172.21.15.16:0/3714898236 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09f0017070 con 0x7f0a080b3cc0 2024-04-27T02:38:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.125+0000 7f09ff400640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f09e406c8f0 0x7f09e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.125+0000 7f09ff400640 1 -- 172.21.15.16:0/3714898236 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f09f008b610 con 0x7f0a080b3cc0 2024-04-27T02:38:37.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.125+0000 7f0a06a00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f09e406c8f0 0x7f09e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.127+0000 7f0a06a00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f09e406c8f0 0x7f09e406edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09f8034000 tx=0x7f09f802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:37.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.130+0000 7f09ff400640 1 -- 172.21.15.16:0/3714898236 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f09f0059a10 con 0x7f0a080b3cc0 2024-04-27T02:38:37.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.328+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a080ba910 con 0x7f09e406c8f0 2024-04-27T02:38:37.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.347+0000 7f09ff400640 1 -- 172.21.15.16:0/3714898236 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7f0a080ba910 con 0x7f09e406c8f0 2024-04-27T02:38:37.324 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:38:37.326 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-27T02:38:37.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.353+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f09e406c8f0 msgr2=0x7f09e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.353+0000 7f0a07e00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f09e406c8f0 0x7f09e406edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09f8034000 tx=0x7f09f802e000 comp rx=0 tx=0).stop 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.353+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b3cc0 msgr2=0x7f0a08137a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.353+0000 7f0a07e00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b3cc0 0x7f0a08137a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b4a0 tx=0x7f09f000b960 comp rx=0 tx=0).stop 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 shutdown_connections 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f09e406c8f0 0x7f09e406edb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0a080b6a90 0x7f0a08137f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a080b3cc0 0x7f0a08137a50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 --2- 172.21.15.16:0/3714898236 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0a080afbd0 0x7f0a080b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 >> 172.21.15.16:0/3714898236 conn(0x7f0a08068270 msgr2=0x7f0a0814b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:37.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 shutdown_connections 2024-04-27T02:38:37.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.354+0000 7f0a07e00640 1 -- 172.21.15.16:0/3714898236 wait complete. 2024-04-27T02:38:37.347 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":5532,"stamp":"2024-04-27T02:38:36.153480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":792815,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":147,"num_read_kb":130,"num_write":329,"num_write_kb":3713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253944,"kb_used_data":3416,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720776,"statfs":{"total":773094113280,"available":772834074624,"internally_reserved":0,"allocated":3497984,"data_stored":2248406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004666"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:43.870953+0000","last_change":"2024-04-26T23:35:33.823180+0000","last_active":"2024-04-27T02:34:43.870953+0000","last_peered":"2024-04-27T02:34:43.870953+0000","last_clean":"2024-04-27T02:34:43.870953+0000","last_became_active":"2024-04-26T23:35:33.822081+0000","last_became_peered":"2024-04-26T23:35:33.822081+0000","last_unstale":"2024-04-27T02:34:43.870953+0000","last_undegraded":"2024-04-27T02:34:43.870953+0000","last_fullsized":"2024-04-27T02:34:43.870953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881829+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-27T02:36:03.881829+0000","last_peered":"2024-04-27T02:36:03.881829+0000","last_clean":"2024-04-27T02:36:03.881829+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-27T02:36:03.881829+0000","last_undegraded":"2024-04-27T02:36:03.881829+0000","last_fullsized":"2024-04-27T02:36:03.881829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"22'1","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881805+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-27T02:36:03.881805+0000","last_peered":"2024-04-27T02:36:03.881805+0000","last_clean":"2024-04-27T02:36:03.881805+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-27T02:36:03.881805+0000","last_undegraded":"2024-04-27T02:36:03.881805+0000","last_fullsized":"2024-04-27T02:36:03.881805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.884759+0000","last_change":"2024-04-26T23:34:46.102692+0000","last_active":"2024-04-27T02:35:18.884759+0000","last_peered":"2024-04-27T02:35:18.884759+0000","last_clean":"2024-04-27T02:35:18.884759+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-27T02:35:18.884759+0000","last_undegraded":"2024-04-27T02:35:18.884759+0000","last_fullsized":"2024-04-27T02:35:18.884759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882951+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-27T02:34:48.882951+0000","last_peered":"2024-04-27T02:34:48.882951+0000","last_clean":"2024-04-27T02:34:48.882951+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-27T02:34:48.882951+0000","last_undegraded":"2024-04-27T02:34:48.882951+0000","last_fullsized":"2024-04-27T02:34:48.882951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.880073+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-27T02:34:48.880073+0000","last_peered":"2024-04-27T02:34:48.880073+0000","last_clean":"2024-04-27T02:34:48.880073+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-27T02:34:48.880073+0000","last_undegraded":"2024-04-27T02:34:48.880073+0000","last_fullsized":"2024-04-27T02:34:48.880073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882868+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-27T02:34:48.882868+0000","last_peered":"2024-04-27T02:34:48.882868+0000","last_clean":"2024-04-27T02:34:48.882868+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-27T02:34:48.882868+0000","last_undegraded":"2024-04-27T02:34:48.882868+0000","last_fullsized":"2024-04-27T02:34:48.882868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.868983+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-27T02:34:48.868983+0000","last_peered":"2024-04-27T02:34:48.868983+0000","last_clean":"2024-04-27T02:34:48.868983+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-27T02:34:48.868983+0000","last_undegraded":"2024-04-27T02:34:48.868983+0000","last_fullsized":"2024-04-27T02:34:48.868983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.169172+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-27T02:34:04.169172+0000","last_peered":"2024-04-27T02:34:04.169172+0000","last_clean":"2024-04-27T02:34:04.169172+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-27T02:34:04.169172+0000","last_undegraded":"2024-04-27T02:34:04.169172+0000","last_fullsized":"2024-04-27T02:34:04.169172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"22'3","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895751+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-27T02:36:03.895751+0000","last_peered":"2024-04-27T02:36:03.895751+0000","last_clean":"2024-04-27T02:36:03.895751+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-27T02:36:03.895751+0000","last_undegraded":"2024-04-27T02:36:03.895751+0000","last_fullsized":"2024-04-27T02:36:03.895751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895708+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-27T02:36:03.895708+0000","last_peered":"2024-04-27T02:36:03.895708+0000","last_clean":"2024-04-27T02:36:03.895708+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-27T02:36:03.895708+0000","last_undegraded":"2024-04-27T02:36:03.895708+0000","last_fullsized":"2024-04-27T02:36:03.895708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895675+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-27T02:36:03.895675+0000","last_peered":"2024-04-27T02:36:03.895675+0000","last_clean":"2024-04-27T02:36:03.895675+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-27T02:36:03.895675+0000","last_undegraded":"2024-04-27T02:36:03.895675+0000","last_fullsized":"2024-04-27T02:36:03.895675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886609+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-27T02:36:03.886609+0000","last_peered":"2024-04-27T02:36:03.886609+0000","last_clean":"2024-04-27T02:36:03.886609+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-27T02:36:03.886609+0000","last_undegraded":"2024-04-27T02:36:03.886609+0000","last_fullsized":"2024-04-27T02:36:03.886609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.876176+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-27T02:34:58.876176+0000","last_peered":"2024-04-27T02:34:58.876176+0000","last_clean":"2024-04-27T02:34:58.876176+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-27T02:34:58.876176+0000","last_undegraded":"2024-04-27T02:34:58.876176+0000","last_fullsized":"2024-04-27T02:34:58.876176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.176263+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-27T02:34:29.176263+0000","last_peered":"2024-04-27T02:34:29.176263+0000","last_clean":"2024-04-27T02:34:29.176263+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-27T02:34:29.176263+0000","last_undegraded":"2024-04-27T02:34:29.176263+0000","last_fullsized":"2024-04-27T02:34:29.176263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187913+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-27T02:34:29.187913+0000","last_peered":"2024-04-27T02:34:29.187913+0000","last_clean":"2024-04-27T02:34:29.187913+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-27T02:34:29.187913+0000","last_undegraded":"2024-04-27T02:34:29.187913+0000","last_fullsized":"2024-04-27T02:34:29.187913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.188052+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-27T02:34:29.188052+0000","last_peered":"2024-04-27T02:34:29.188052+0000","last_clean":"2024-04-27T02:34:29.188052+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-27T02:34:29.188052+0000","last_undegraded":"2024-04-27T02:34:29.188052+0000","last_fullsized":"2024-04-27T02:34:29.188052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:37.828024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158366+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-27T02:34:29.158366+0000","last_peered":"2024-04-27T02:34:29.158366+0000","last_clean":"2024-04-27T02:34:29.158366+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-27T02:34:29.158366+0000","last_undegraded":"2024-04-27T02:34:29.158366+0000","last_fullsized":"2024-04-27T02:34:29.158366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.889371+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-27T02:35:18.889371+0000","last_peered":"2024-04-27T02:35:18.889371+0000","last_clean":"2024-04-27T02:35:18.889371+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-27T02:35:18.889371+0000","last_undegraded":"2024-04-27T02:35:18.889371+0000","last_fullsized":"2024-04-27T02:35:18.889371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:09.342327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"22'1","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882992+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-27T02:34:48.882992+0000","last_peered":"2024-04-27T02:34:48.882992+0000","last_clean":"2024-04-27T02:34:48.882992+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-27T02:34:48.882992+0000","last_undegraded":"2024-04-27T02:34:48.882992+0000","last_fullsized":"2024-04-27T02:34:48.882992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"22'3","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877811+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-27T02:34:48.877811+0000","last_peered":"2024-04-27T02:34:48.877811+0000","last_clean":"2024-04-27T02:34:48.877811+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-27T02:34:48.877811+0000","last_undegraded":"2024-04-27T02:34:48.877811+0000","last_fullsized":"2024-04-27T02:34:48.877811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"22'1","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877782+0000","last_change":"2024-04-26T23:34:46.096164+0000","last_active":"2024-04-27T02:34:48.877782+0000","last_peered":"2024-04-27T02:34:48.877782+0000","last_clean":"2024-04-27T02:34:48.877782+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-27T02:34:48.877782+0000","last_undegraded":"2024-04-27T02:34:48.877782+0000","last_fullsized":"2024-04-27T02:34:48.877782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869060+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-27T02:34:48.869060+0000","last_peered":"2024-04-27T02:34:48.869060+0000","last_clean":"2024-04-27T02:34:48.869060+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-27T02:34:48.869060+0000","last_undegraded":"2024-04-27T02:34:48.869060+0000","last_fullsized":"2024-04-27T02:34:48.869060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"22'5","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.887661+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-27T02:35:08.887661+0000","last_peered":"2024-04-27T02:35:08.887661+0000","last_clean":"2024-04-27T02:35:08.887661+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-27T02:35:08.887661+0000","last_undegraded":"2024-04-27T02:35:08.887661+0000","last_fullsized":"2024-04-27T02:35:08.887661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.867416+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-27T02:34:38.867416+0000","last_peered":"2024-04-27T02:34:38.867416+0000","last_clean":"2024-04-27T02:34:38.867416+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-27T02:34:38.867416+0000","last_undegraded":"2024-04-27T02:34:38.867416+0000","last_fullsized":"2024-04-27T02:34:38.867416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.878566+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-27T02:34:38.878566+0000","last_peered":"2024-04-27T02:34:38.878566+0000","last_clean":"2024-04-27T02:34:38.878566+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-27T02:34:38.878566+0000","last_undegraded":"2024-04-27T02:34:38.878566+0000","last_fullsized":"2024-04-27T02:34:38.878566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873079+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-27T02:34:38.873079+0000","last_peered":"2024-04-27T02:34:38.873079+0000","last_clean":"2024-04-27T02:34:38.873079+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-27T02:34:38.873079+0000","last_undegraded":"2024-04-27T02:34:38.873079+0000","last_fullsized":"2024-04-27T02:34:38.873079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873013+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-27T02:34:38.873013+0000","last_peered":"2024-04-27T02:34:38.873013+0000","last_clean":"2024-04-27T02:34:38.873013+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-27T02:34:38.873013+0000","last_undegraded":"2024-04-27T02:34:38.873013+0000","last_fullsized":"2024-04-27T02:34:38.873013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.175396+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-27T02:34:24.175396+0000","last_peered":"2024-04-27T02:34:24.175396+0000","last_clean":"2024-04-27T02:34:24.175396+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-27T02:34:24.175396+0000","last_undegraded":"2024-04-27T02:34:24.175396+0000","last_fullsized":"2024-04-27T02:34:24.175396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:54.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896455+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-27T02:36:03.896455+0000","last_peered":"2024-04-27T02:36:03.896455+0000","last_clean":"2024-04-27T02:36:03.896455+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-27T02:36:03.896455+0000","last_undegraded":"2024-04-27T02:36:03.896455+0000","last_fullsized":"2024-04-27T02:36:03.896455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:08.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882856+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-27T02:36:03.882856+0000","last_peered":"2024-04-27T02:36:03.882856+0000","last_clean":"2024-04-27T02:36:03.882856+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-27T02:36:03.882856+0000","last_undegraded":"2024-04-27T02:36:03.882856+0000","last_fullsized":"2024-04-27T02:36:03.882856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.891627+0000","last_change":"2024-04-26T23:34:46.098997+0000","last_active":"2024-04-27T02:36:03.891627+0000","last_peered":"2024-04-27T02:36:03.891627+0000","last_clean":"2024-04-27T02:36:03.891627+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-27T02:36:03.891627+0000","last_undegraded":"2024-04-27T02:36:03.891627+0000","last_fullsized":"2024-04-27T02:36:03.891627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877841+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-27T02:34:48.877841+0000","last_peered":"2024-04-27T02:34:48.877841+0000","last_clean":"2024-04-27T02:34:48.877841+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-27T02:34:48.877841+0000","last_undegraded":"2024-04-27T02:34:48.877841+0000","last_fullsized":"2024-04-27T02:34:48.877841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869110+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-27T02:34:48.869110+0000","last_peered":"2024-04-27T02:34:48.869110+0000","last_clean":"2024-04-27T02:34:48.869110+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-27T02:34:48.869110+0000","last_undegraded":"2024-04-27T02:34:48.869110+0000","last_fullsized":"2024-04-27T02:34:48.869110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877875+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-27T02:34:48.877875+0000","last_peered":"2024-04-27T02:34:48.877875+0000","last_clean":"2024-04-27T02:34:48.877875+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-27T02:34:48.877875+0000","last_undegraded":"2024-04-27T02:34:48.877875+0000","last_fullsized":"2024-04-27T02:34:48.877875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884228+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-27T02:34:48.884228+0000","last_peered":"2024-04-27T02:34:48.884228+0000","last_clean":"2024-04-27T02:34:48.884228+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-27T02:34:48.884228+0000","last_undegraded":"2024-04-27T02:34:48.884228+0000","last_fullsized":"2024-04-27T02:34:48.884228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.166242+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-27T02:34:04.166242+0000","last_peered":"2024-04-27T02:34:04.166242+0000","last_clean":"2024-04-27T02:34:04.166242+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-27T02:34:04.166242+0000","last_undegraded":"2024-04-27T02:34:04.166242+0000","last_fullsized":"2024-04-27T02:34:04.166242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881735+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-27T02:36:03.881735+0000","last_peered":"2024-04-27T02:36:03.881735+0000","last_clean":"2024-04-27T02:36:03.881735+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-27T02:36:03.881735+0000","last_undegraded":"2024-04-27T02:36:03.881735+0000","last_fullsized":"2024-04-27T02:36:03.881735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896414+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-27T02:36:03.896414+0000","last_peered":"2024-04-27T02:36:03.896414+0000","last_clean":"2024-04-27T02:36:03.896414+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-27T02:36:03.896414+0000","last_undegraded":"2024-04-27T02:36:03.896414+0000","last_fullsized":"2024-04-27T02:36:03.896414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.165505+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-27T02:34:04.165505+0000","last_peered":"2024-04-27T02:34:04.165505+0000","last_clean":"2024-04-27T02:34:04.165505+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-27T02:34:04.165505+0000","last_undegraded":"2024-04-27T02:34:04.165505+0000","last_fullsized":"2024-04-27T02:34:04.165505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889946+0000","last_change":"2024-04-26T23:34:45.074623+0000","last_active":"2024-04-27T02:36:03.889946+0000","last_peered":"2024-04-27T02:36:03.889946+0000","last_clean":"2024-04-27T02:36:03.889946+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-27T02:36:03.889946+0000","last_undegraded":"2024-04-27T02:36:03.889946+0000","last_fullsized":"2024-04-27T02:36:03.889946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.891680+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-27T02:36:03.891680+0000","last_peered":"2024-04-27T02:36:03.891680+0000","last_clean":"2024-04-27T02:36:03.891680+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-27T02:36:03.891680+0000","last_undegraded":"2024-04-27T02:36:03.891680+0000","last_fullsized":"2024-04-27T02:36:03.891680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895771+0000","last_change":"2024-04-26T23:34:45.073763+0000","last_active":"2024-04-27T02:36:03.895771+0000","last_peered":"2024-04-27T02:36:03.895771+0000","last_clean":"2024-04-27T02:36:03.895771+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-27T02:36:03.895771+0000","last_undegraded":"2024-04-27T02:36:03.895771+0000","last_fullsized":"2024-04-27T02:36:03.895771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:07.508274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881878+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-27T02:36:03.881878+0000","last_peered":"2024-04-27T02:36:03.881878+0000","last_clean":"2024-04-27T02:36:03.881878+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-27T02:36:03.881878+0000","last_undegraded":"2024-04-27T02:36:03.881878+0000","last_fullsized":"2024-04-27T02:36:03.881878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882929+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-27T02:36:03.882929+0000","last_peered":"2024-04-27T02:36:03.882929+0000","last_clean":"2024-04-27T02:36:03.882929+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-27T02:36:03.882929+0000","last_undegraded":"2024-04-27T02:36:03.882929+0000","last_fullsized":"2024-04-27T02:36:03.882929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.886165+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-27T02:34:58.886165+0000","last_peered":"2024-04-27T02:34:58.886165+0000","last_clean":"2024-04-27T02:34:58.886165+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-27T02:34:58.886165+0000","last_undegraded":"2024-04-27T02:34:58.886165+0000","last_fullsized":"2024-04-27T02:34:58.886165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:03.761817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'55","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.881588+0000","last_change":"2024-04-26T23:34:45.074276+0000","last_active":"2024-04-27T02:34:58.881588+0000","last_peered":"2024-04-27T02:34:58.881588+0000","last_clean":"2024-04-27T02:34:58.881588+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-27T02:34:58.881588+0000","last_undegraded":"2024-04-27T02:34:58.881588+0000","last_fullsized":"2024-04-27T02:34:58.881588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:33.430917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199217,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895730+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-27T02:36:03.895730+0000","last_peered":"2024-04-27T02:36:03.895730+0000","last_clean":"2024-04-27T02:36:03.895730+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-27T02:36:03.895730+0000","last_undegraded":"2024-04-27T02:36:03.895730+0000","last_fullsized":"2024-04-27T02:36:03.895730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158273+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-27T02:34:29.158273+0000","last_peered":"2024-04-27T02:34:29.158273+0000","last_clean":"2024-04-27T02:34:29.158273+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-27T02:34:29.158273+0000","last_undegraded":"2024-04-27T02:34:29.158273+0000","last_fullsized":"2024-04-27T02:34:29.158273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.170403+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-27T02:34:29.170403+0000","last_peered":"2024-04-27T02:34:29.170403+0000","last_clean":"2024-04-27T02:34:29.170403+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-27T02:34:29.170403+0000","last_undegraded":"2024-04-27T02:34:29.170403+0000","last_fullsized":"2024-04-27T02:34:29.170403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187994+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-27T02:34:29.187994+0000","last_peered":"2024-04-27T02:34:29.187994+0000","last_clean":"2024-04-27T02:34:29.187994+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-27T02:34:29.187994+0000","last_undegraded":"2024-04-27T02:34:29.187994+0000","last_fullsized":"2024-04-27T02:34:29.187994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:49.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.188014+0000","last_change":"2024-04-26T23:34:46.093800+0000","last_active":"2024-04-27T02:34:29.188014+0000","last_peered":"2024-04-27T02:34:29.188014+0000","last_clean":"2024-04-27T02:34:29.188014+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-27T02:34:29.188014+0000","last_undegraded":"2024-04-27T02:34:29.188014+0000","last_fullsized":"2024-04-27T02:34:29.188014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:07.701378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.186924+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-27T02:34:29.186924+0000","last_peered":"2024-04-27T02:34:29.186924+0000","last_clean":"2024-04-27T02:34:29.186924+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-27T02:34:29.186924+0000","last_undegraded":"2024-04-27T02:34:29.186924+0000","last_fullsized":"2024-04-27T02:34:29.186924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.173518+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-27T02:34:29.173518+0000","last_peered":"2024-04-27T02:34:29.173518+0000","last_clean":"2024-04-27T02:34:29.173518+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-27T02:34:29.173518+0000","last_undegraded":"2024-04-27T02:34:29.173518+0000","last_fullsized":"2024-04-27T02:34:29.173518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:08.523129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.169460+0000","last_change":"2024-04-26T23:34:45.072379+0000","last_active":"2024-04-27T02:34:29.169460+0000","last_peered":"2024-04-27T02:34:29.169460+0000","last_clean":"2024-04-27T02:34:29.169460+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-27T02:34:29.169460+0000","last_undegraded":"2024-04-27T02:34:29.169460+0000","last_fullsized":"2024-04-27T02:34:29.169460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187961+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-27T02:34:29.187961+0000","last_peered":"2024-04-27T02:34:29.187961+0000","last_clean":"2024-04-27T02:34:29.187961+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-27T02:34:29.187961+0000","last_undegraded":"2024-04-27T02:34:29.187961+0000","last_fullsized":"2024-04-27T02:34:29.187961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.888296+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-27T02:35:18.888296+0000","last_peered":"2024-04-27T02:35:18.888296+0000","last_clean":"2024-04-27T02:35:18.888296+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-27T02:35:18.888296+0000","last_undegraded":"2024-04-27T02:35:18.888296+0000","last_fullsized":"2024-04-27T02:35:18.888296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.880158+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-27T02:34:48.880158+0000","last_peered":"2024-04-27T02:34:48.880158+0000","last_clean":"2024-04-27T02:34:48.880158+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-27T02:34:48.880158+0000","last_undegraded":"2024-04-27T02:34:48.880158+0000","last_fullsized":"2024-04-27T02:34:48.880158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877924+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-27T02:34:48.877924+0000","last_peered":"2024-04-27T02:34:48.877924+0000","last_clean":"2024-04-27T02:34:48.877924+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-27T02:34:48.877924+0000","last_undegraded":"2024-04-27T02:34:48.877924+0000","last_fullsized":"2024-04-27T02:34:48.877924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.888247+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-27T02:35:18.888247+0000","last_peered":"2024-04-27T02:35:18.888247+0000","last_clean":"2024-04-27T02:35:18.888247+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-27T02:35:18.888247+0000","last_undegraded":"2024-04-27T02:35:18.888247+0000","last_fullsized":"2024-04-27T02:35:18.888247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869159+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-27T02:34:48.869159+0000","last_peered":"2024-04-27T02:34:48.869159+0000","last_clean":"2024-04-27T02:34:48.869159+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-27T02:34:48.869159+0000","last_undegraded":"2024-04-27T02:34:48.869159+0000","last_fullsized":"2024-04-27T02:34:48.869159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883029+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-27T02:34:48.883029+0000","last_peered":"2024-04-27T02:34:48.883029+0000","last_clean":"2024-04-27T02:34:48.883029+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-27T02:34:48.883029+0000","last_undegraded":"2024-04-27T02:34:48.883029+0000","last_fullsized":"2024-04-27T02:34:48.883029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.874659+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-27T02:34:48.874659+0000","last_peered":"2024-04-27T02:34:48.874659+0000","last_clean":"2024-04-27T02:34:48.874659+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-27T02:34:48.874659+0000","last_undegraded":"2024-04-27T02:34:48.874659+0000","last_fullsized":"2024-04-27T02:34:48.874659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884327+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-27T02:34:48.884327+0000","last_peered":"2024-04-27T02:34:48.884327+0000","last_clean":"2024-04-27T02:34:48.884327+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-27T02:34:48.884327+0000","last_undegraded":"2024-04-27T02:34:48.884327+0000","last_fullsized":"2024-04-27T02:34:48.884327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:10.277157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'161","reported_seq":318,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:13.881887+0000","last_change":"2024-04-26T23:34:41.212862+0000","last_active":"2024-04-27T02:35:13.881887+0000","last_peered":"2024-04-27T02:35:13.881887+0000","last_clean":"2024-04-27T02:35:13.881887+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-27T02:35:13.881887+0000","last_undegraded":"2024-04-27T02:35:13.881887+0000","last_fullsized":"2024-04-27T02:35:13.881887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_clean_scrub_stamp":"2024-04-26T23:34:39.876770+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:44.232023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896518+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-27T02:36:03.896518+0000","last_peered":"2024-04-27T02:36:03.896518+0000","last_clean":"2024-04-27T02:36:03.896518+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-27T02:36:03.896518+0000","last_undegraded":"2024-04-27T02:36:03.896518+0000","last_fullsized":"2024-04-27T02:36:03.896518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:35.809938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889767+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-27T02:36:03.889767+0000","last_peered":"2024-04-27T02:36:03.889767+0000","last_clean":"2024-04-27T02:36:03.889767+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-27T02:36:03.889767+0000","last_undegraded":"2024-04-27T02:36:03.889767+0000","last_fullsized":"2024-04-27T02:36:03.889767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.889297+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-27T02:35:18.889297+0000","last_peered":"2024-04-27T02:35:18.889297+0000","last_clean":"2024-04-27T02:35:18.889297+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-27T02:35:18.889297+0000","last_undegraded":"2024-04-27T02:35:18.889297+0000","last_fullsized":"2024-04-27T02:35:18.889297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886561+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-27T02:36:03.886561+0000","last_peered":"2024-04-27T02:36:03.886561+0000","last_clean":"2024-04-27T02:36:03.886561+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-27T02:36:03.886561+0000","last_undegraded":"2024-04-27T02:36:03.886561+0000","last_fullsized":"2024-04-27T02:36:03.886561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882893+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-27T02:36:03.882893+0000","last_peered":"2024-04-27T02:36:03.882893+0000","last_clean":"2024-04-27T02:36:03.882893+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-27T02:36:03.882893+0000","last_undegraded":"2024-04-27T02:36:03.882893+0000","last_fullsized":"2024-04-27T02:36:03.882893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":1,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"22'2","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874268+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-27T02:35:18.874268+0000","last_peered":"2024-04-27T02:35:18.874268+0000","last_clean":"2024-04-27T02:35:18.874268+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-27T02:35:18.874268+0000","last_undegraded":"2024-04-27T02:35:18.874268+0000","last_fullsized":"2024-04-27T02:35:18.874268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896490+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-27T02:36:03.896490+0000","last_peered":"2024-04-27T02:36:03.896490+0000","last_clean":"2024-04-27T02:36:03.896490+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-27T02:36:03.896490+0000","last_undegraded":"2024-04-27T02:36:03.896490+0000","last_fullsized":"2024-04-27T02:36:03.896490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:21.723421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895639+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-27T02:36:03.895639+0000","last_peered":"2024-04-27T02:36:03.895639+0000","last_clean":"2024-04-27T02:36:03.895639+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-27T02:36:03.895639+0000","last_undegraded":"2024-04-27T02:36:03.895639+0000","last_fullsized":"2024-04-27T02:36:03.895639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881786+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-27T02:36:03.881786+0000","last_peered":"2024-04-27T02:36:03.881786+0000","last_clean":"2024-04-27T02:36:03.881786+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-27T02:36:03.881786+0000","last_undegraded":"2024-04-27T02:36:03.881786+0000","last_fullsized":"2024-04-27T02:36:03.881786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'3","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.171989+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-27T02:34:24.171989+0000","last_peered":"2024-04-27T02:34:24.171989+0000","last_clean":"2024-04-27T02:34:24.171989+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-27T02:34:24.171989+0000","last_undegraded":"2024-04-27T02:34:24.171989+0000","last_fullsized":"2024-04-27T02:34:24.171989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.186989+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-27T02:34:24.186989+0000","last_peered":"2024-04-27T02:34:24.186989+0000","last_clean":"2024-04-27T02:34:24.186989+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-27T02:34:24.186989+0000","last_undegraded":"2024-04-27T02:34:24.186989+0000","last_fullsized":"2024-04-27T02:34:24.186989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:33.819205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886639+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-27T02:36:03.886639+0000","last_peered":"2024-04-27T02:36:03.886639+0000","last_clean":"2024-04-27T02:36:03.886639+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-27T02:36:03.886639+0000","last_undegraded":"2024-04-27T02:36:03.886639+0000","last_fullsized":"2024-04-27T02:36:03.886639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'5","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.876020+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-27T02:34:38.876020+0000","last_peered":"2024-04-27T02:34:38.876020+0000","last_clean":"2024-04-27T02:34:38.876020+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-27T02:34:38.876020+0000","last_undegraded":"2024-04-27T02:34:38.876020+0000","last_fullsized":"2024-04-27T02:34:38.876020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'4","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.876040+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-27T02:34:38.876040+0000","last_peered":"2024-04-27T02:34:38.876040+0000","last_clean":"2024-04-27T02:34:38.876040+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-27T02:34:38.876040+0000","last_undegraded":"2024-04-27T02:34:38.876040+0000","last_fullsized":"2024-04-27T02:34:38.876040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'3","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.882669+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-27T02:34:38.882669+0000","last_peered":"2024-04-27T02:34:38.882669+0000","last_clean":"2024-04-27T02:34:38.882669+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-27T02:34:38.882669+0000","last_undegraded":"2024-04-27T02:34:38.882669+0000","last_fullsized":"2024-04-27T02:34:38.882669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:19.687355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875998+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-27T02:34:38.875998+0000","last_peered":"2024-04-27T02:34:38.875998+0000","last_clean":"2024-04-27T02:34:38.875998+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-27T02:34:38.875998+0000","last_undegraded":"2024-04-27T02:34:38.875998+0000","last_fullsized":"2024-04-27T02:34:38.875998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.881192+0000","last_change":"2024-04-26T23:34:45.076058+0000","last_active":"2024-04-27T02:34:38.881192+0000","last_peered":"2024-04-27T02:34:38.881192+0000","last_clean":"2024-04-27T02:34:38.881192+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-27T02:34:38.881192+0000","last_undegraded":"2024-04-27T02:34:38.881192+0000","last_fullsized":"2024-04-27T02:34:38.881192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.882474+0000","last_change":"2024-04-26T23:34:46.092601+0000","last_active":"2024-04-27T02:34:38.882474+0000","last_peered":"2024-04-27T02:34:38.882474+0000","last_clean":"2024-04-27T02:34:38.882474+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-27T02:34:38.882474+0000","last_undegraded":"2024-04-27T02:34:38.882474+0000","last_fullsized":"2024-04-27T02:34:38.882474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:01.319097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875932+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-27T02:34:38.875932+0000","last_peered":"2024-04-27T02:34:38.875932+0000","last_clean":"2024-04-27T02:34:38.875932+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-27T02:34:38.875932+0000","last_undegraded":"2024-04-27T02:34:38.875932+0000","last_fullsized":"2024-04-27T02:34:38.875932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875867+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-27T02:34:38.875867+0000","last_peered":"2024-04-27T02:34:38.875867+0000","last_clean":"2024-04-27T02:34:38.875867+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-27T02:34:38.875867+0000","last_undegraded":"2024-04-27T02:34:38.875867+0000","last_fullsized":"2024-04-27T02:34:38.875867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.877678+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-27T02:35:08.877678+0000","last_peered":"2024-04-27T02:35:08.877678+0000","last_clean":"2024-04-27T02:35:08.877678+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-27T02:35:08.877678+0000","last_undegraded":"2024-04-27T02:35:08.877678+0000","last_fullsized":"2024-04-27T02:35:08.877678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.871792+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-27T02:34:48.871792+0000","last_peered":"2024-04-27T02:34:48.871792+0000","last_clean":"2024-04-27T02:34:48.871792+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-27T02:34:48.871792+0000","last_undegraded":"2024-04-27T02:34:48.871792+0000","last_fullsized":"2024-04-27T02:34:48.871792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884278+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-27T02:34:48.884278+0000","last_peered":"2024-04-27T02:34:48.884278+0000","last_clean":"2024-04-27T02:34:48.884278+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-27T02:34:48.884278+0000","last_undegraded":"2024-04-27T02:34:48.884278+0000","last_fullsized":"2024-04-27T02:34:48.884278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:35.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.887716+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-27T02:35:08.887716+0000","last_peered":"2024-04-27T02:35:08.887716+0000","last_clean":"2024-04-27T02:35:08.887716+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-27T02:35:08.887716+0000","last_undegraded":"2024-04-27T02:35:08.887716+0000","last_fullsized":"2024-04-27T02:35:08.887716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:37.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884310+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-27T02:34:48.884310+0000","last_peered":"2024-04-27T02:34:48.884310+0000","last_clean":"2024-04-27T02:34:48.884310+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-27T02:34:48.884310+0000","last_undegraded":"2024-04-27T02:34:48.884310+0000","last_fullsized":"2024-04-27T02:34:48.884310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883060+0000","last_change":"2024-04-26T23:34:45.075234+0000","last_active":"2024-04-27T02:34:48.883060+0000","last_peered":"2024-04-27T02:34:48.883060+0000","last_clean":"2024-04-27T02:34:48.883060+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-27T02:34:48.883060+0000","last_undegraded":"2024-04-27T02:34:48.883060+0000","last_fullsized":"2024-04-27T02:34:48.883060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877876+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-27T02:34:48.877876+0000","last_peered":"2024-04-27T02:34:48.877876+0000","last_clean":"2024-04-27T02:34:48.877876+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-27T02:34:48.877876+0000","last_undegraded":"2024-04-27T02:34:48.877876+0000","last_fullsized":"2024-04-27T02:34:48.877876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883144+0000","last_change":"2024-04-26T23:34:45.074596+0000","last_active":"2024-04-27T02:34:48.883144+0000","last_peered":"2024-04-27T02:34:48.883144+0000","last_clean":"2024-04-27T02:34:48.883144+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-27T02:34:48.883144+0000","last_undegraded":"2024-04-27T02:34:48.883144+0000","last_fullsized":"2024-04-27T02:34:48.883144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881855+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-27T02:36:03.881855+0000","last_peered":"2024-04-27T02:36:03.881855+0000","last_clean":"2024-04-27T02:36:03.881855+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-27T02:36:03.881855+0000","last_undegraded":"2024-04-27T02:36:03.881855+0000","last_fullsized":"2024-04-27T02:36:03.881855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874398+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-27T02:35:18.874398+0000","last_peered":"2024-04-27T02:35:18.874398+0000","last_clean":"2024-04-27T02:35:18.874398+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-27T02:35:18.874398+0000","last_undegraded":"2024-04-27T02:35:18.874398+0000","last_fullsized":"2024-04-27T02:35:18.874398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874378+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-27T02:35:18.874378+0000","last_peered":"2024-04-27T02:35:18.874378+0000","last_clean":"2024-04-27T02:35:18.874378+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-27T02:35:18.874378+0000","last_undegraded":"2024-04-27T02:35:18.874378+0000","last_fullsized":"2024-04-27T02:35:18.874378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889818+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-27T02:36:03.889818+0000","last_peered":"2024-04-27T02:36:03.889818+0000","last_clean":"2024-04-27T02:36:03.889818+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-27T02:36:03.889818+0000","last_undegraded":"2024-04-27T02:36:03.889818+0000","last_fullsized":"2024-04-27T02:36:03.889818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":202439,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":102,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":404878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834577058,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":85395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834577057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":229376,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834577057,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":839680,"data_stored":675739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834577057,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":446464,"data_stored":282736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834577057,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":83437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834577057,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":438272,"data_stored":282064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834577057,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":827392,"data_stored":673285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834577057,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":199217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-27T02:38:37.351 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-27T02:38:37.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-27T02:38:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.630+0000 7f531ce00640 1 Processor -- start 2024-04-27T02:38:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.631+0000 7f531ce00640 1 -- start start 2024-04-27T02:38:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.632+0000 7f531ce00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 0x7f53180b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.632+0000 7f531ce00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53180bbf90 con 0x7f53180bbbb0 2024-04-27T02:38:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.632+0000 7f531ce00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53180b72a0 con 0x7f5318073b80 2024-04-27T02:38:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.632+0000 7f531ce00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f53180b7050 con 0x7f53181469c0 2024-04-27T02:38:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.632+0000 7f5317400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f53180bbbb0 0x7f53181462b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47340/0 (socket says 172.21.15.16:47340) 2024-04-27T02:38:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.632+0000 7f5317400640 1 -- 172.21.15.16:0/258817429 learned_addr learned my addr 172.21.15.16:0/258817429 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:37.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316a00640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 0x7f53180b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632876757 0 0) 0x7f53180bbf90 con 0x7f53180bbbb0 2024-04-27T02:38:37.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52fc003520 con 0x7f53180bbbb0 2024-04-27T02:38:37.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990875981 0 0) 0x7f52fc003520 con 0x7f53180bbbb0 2024-04-27T02:38:37.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 msgr2=0x7f53180b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:37.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 0x7f53180b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 >> v1:172.21.15.32:6789/0 conn(0x7f5318073b80 legacy=0x7f5318150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53180b78e0 con 0x7f53180bbbb0 2024-04-27T02:38:37.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f5308001670 con 0x7f53180bbbb0 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.633+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 >> v1:172.21.15.16:6789/0 conn(0x7f53180bbbb0 legacy=0x7f53181462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5316000640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc0039e0 0x7f52fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5316000640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 0x7f52fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5316000640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52fc004d40 0x7f52fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f53180b7050 con 0x7f52fc0039e0 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc00bb80 con 0x7f52fc004d40 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f52fc00bd80 con 0x7f53181469c0 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5317400640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc0039e0 0x7f52fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5316a00640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 0x7f52fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5317e00640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52fc004d40 0x7f52fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5317400640 1 -- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 msgr2=0x7f52fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:37.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.634+0000 7f5317400640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f53181469c0 0x7f52fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.635+0000 7f5317400640 1 -- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52fc004d40 msgr2=0x7f52fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:37.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.635+0000 7f5317400640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f52fc004d40 0x7f52fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.635+0000 7f5317400640 1 -- 172.21.15.16:0/258817429 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52fc003520 con 0x7f52fc0039e0 2024-04-27T02:38:37.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.636+0000 7f5317400640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc0039e0 0x7f52fc003e00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f530800c240 tx=0x7f52fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ac15668ab3f3af server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:37.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.636+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308007cf0 con 0x7f52fc0039e0 2024-04-27T02:38:37.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.636+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53080058d0 con 0x7f52fc0039e0 2024-04-27T02:38:37.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.636+0000 7f5316000640 1 -- 172.21.15.16:0/258817429 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308005d60 con 0x7f52fc0039e0 2024-04-27T02:38:37.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.637+0000 7f531ce00640 1 -- 172.21.15.16:0/258817429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc0039e0 msgr2=0x7f52fc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.637+0000 7f531ce00640 1 --2- 172.21.15.16:0/258817429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc0039e0 0x7f52fc003e00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f530800c240 tx=0x7f52fc005830 comp rx=0 tx=0).stop 2024-04-27T02:38:37.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.637+0000 7f5317e00640 1 -- 172.21.15.16:0/258817429 reap_dead start 2024-04-27T02:38:37.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.637+0000 7f531ce00640 1 -- 172.21.15.16:0/258817429 shutdown_connections 2024-04-27T02:38:37.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.637+0000 7f531ce00640 1 -- 172.21.15.16:0/258817429 >> 172.21.15.16:0/258817429 conn(0x7f5318068090 msgr2=0x7f53180684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:37.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.637+0000 7f531ce00640 1 -- 172.21.15.16:0/258817429 shutdown_connections 2024-04-27T02:38:37.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.637+0000 7f531ce00640 1 -- 172.21.15.16:0/258817429 wait complete. 2024-04-27T02:38:37.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.639+0000 7f531ce00640 1 Processor -- start 2024-04-27T02:38:37.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.639+0000 7f531ce00640 1 -- start start 2024-04-27T02:38:37.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f531ce00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f531813a760 0x7f531813cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f531ce00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f531813e0f0 0x7f53181e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f531ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f531813ab40 0x7f53181ddc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f531ce00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f53180b2a60 con 0x7f531813ab40 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f531ce00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f53180b7690 con 0x7f531813e0f0 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f531ce00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f53180b2be0 con 0x7f531813a760 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f5317e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f531813ab40 0x7f53181ddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f5317e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f531813ab40 0x7f53181ddc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38516/0 (socket says 172.21.15.16:38516) 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f5317e00640 1 -- 172.21.15.16:0/2257453124 learned_addr learned my addr 172.21.15.16:0/2257453124 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:37.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f5317400640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f531813a760 0x7f531813cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.640+0000 7f5316a00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f531813e0f0 0x7f53181e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f5317e00640 1 -- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f531813a760 msgr2=0x7f531813cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f5317e00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f531813a760 0x7f531813cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f5317e00640 1 -- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f531813e0f0 msgr2=0x7f53181e1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f5317e00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f531813e0f0 0x7f53181e1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f5317e00640 1 -- 172.21.15.16:0/2257453124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5318140dd0 con 0x7f531813ab40 2024-04-27T02:38:37.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f5316a00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f531813e0f0 0x7f53181e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:37.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f5317e00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f531813ab40 0x7f53181ddc90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53180b8410 tx=0x7f531000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:37.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f530f400640 1 -- 172.21.15.16:0/2257453124 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310003970 con 0x7f531813ab40 2024-04-27T02:38:37.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f530f400640 1 -- 172.21.15.16:0/2257453124 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5310018070 con 0x7f531813ab40 2024-04-27T02:38:37.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531813e900 con 0x7f531813ab40 2024-04-27T02:38:37.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f530f400640 1 -- 172.21.15.16:0/2257453124 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310003d70 con 0x7f531813ab40 2024-04-27T02:38:37.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.641+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5318140af0 con 0x7f531813ab40 2024-04-27T02:38:37.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.643+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5318076600 con 0x7f531813ab40 2024-04-27T02:38:37.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.644+0000 7f530f400640 1 -- 172.21.15.16:0/2257453124 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53100050d0 con 0x7f531813ab40 2024-04-27T02:38:37.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.645+0000 7f530f400640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f52f806c970 0x7f52f806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:37.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.645+0000 7f530f400640 1 -- 172.21.15.16:0/2257453124 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f531008b7c0 con 0x7f531813ab40 2024-04-27T02:38:37.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.645+0000 7f5317400640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f52f806c970 0x7f52f806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:37.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.646+0000 7f5317400640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f52f806c970 0x7f52f806ee30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5308033000 tx=0x7f5308009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:37.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.649+0000 7f530f400640 1 -- 172.21.15.16:0/2257453124 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f53100595f0 con 0x7f531813ab40 2024-04-27T02:38:37.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.853+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5318143b30 con 0x7f52f806c970 2024-04-27T02:38:37.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.872+0000 7f530f400640 1 -- 172.21.15.16:0/2257453124 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7f5318143b30 con 0x7f52f806c970 2024-04-27T02:38:37.850 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:38:37.851 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-27T02:38:37.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.878+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f52f806c970 msgr2=0x7f52f806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.878+0000 7f531ce00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f52f806c970 0x7f52f806ee30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5308033000 tx=0x7f5308009030 comp rx=0 tx=0).stop 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.878+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f531813ab40 msgr2=0x7f53181ddc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.878+0000 7f531ce00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f531813ab40 0x7f53181ddc90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53180b8410 tx=0x7f531000ec10 comp rx=0 tx=0).stop 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 shutdown_connections 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f52f806c970 0x7f52f806ee30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f531813e0f0 0x7f53181e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f531813ab40 0x7f53181ddc90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 --2- 172.21.15.16:0/2257453124 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f531813a760 0x7f531813cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:37.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 >> 172.21.15.16:0/2257453124 conn(0x7f5318068090 msgr2=0x7f5318144500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:37.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 shutdown_connections 2024-04-27T02:38:37.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:37.879+0000 7f531ce00640 1 -- 172.21.15.16:0/2257453124 wait complete. 2024-04-27T02:38:37.873 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":5532,"stamp":"2024-04-27T02:38:36.153480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":792815,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":147,"num_read_kb":130,"num_write":329,"num_write_kb":3713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253944,"kb_used_data":3416,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720776,"statfs":{"total":773094113280,"available":772834074624,"internally_reserved":0,"allocated":3497984,"data_stored":2248406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004666"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:43.870953+0000","last_change":"2024-04-26T23:35:33.823180+0000","last_active":"2024-04-27T02:34:43.870953+0000","last_peered":"2024-04-27T02:34:43.870953+0000","last_clean":"2024-04-27T02:34:43.870953+0000","last_became_active":"2024-04-26T23:35:33.822081+0000","last_became_peered":"2024-04-26T23:35:33.822081+0000","last_unstale":"2024-04-27T02:34:43.870953+0000","last_undegraded":"2024-04-27T02:34:43.870953+0000","last_fullsized":"2024-04-27T02:34:43.870953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881829+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-27T02:36:03.881829+0000","last_peered":"2024-04-27T02:36:03.881829+0000","last_clean":"2024-04-27T02:36:03.881829+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-27T02:36:03.881829+0000","last_undegraded":"2024-04-27T02:36:03.881829+0000","last_fullsized":"2024-04-27T02:36:03.881829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"22'1","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881805+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-27T02:36:03.881805+0000","last_peered":"2024-04-27T02:36:03.881805+0000","last_clean":"2024-04-27T02:36:03.881805+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-27T02:36:03.881805+0000","last_undegraded":"2024-04-27T02:36:03.881805+0000","last_fullsized":"2024-04-27T02:36:03.881805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.884759+0000","last_change":"2024-04-26T23:34:46.102692+0000","last_active":"2024-04-27T02:35:18.884759+0000","last_peered":"2024-04-27T02:35:18.884759+0000","last_clean":"2024-04-27T02:35:18.884759+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-27T02:35:18.884759+0000","last_undegraded":"2024-04-27T02:35:18.884759+0000","last_fullsized":"2024-04-27T02:35:18.884759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882951+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-27T02:34:48.882951+0000","last_peered":"2024-04-27T02:34:48.882951+0000","last_clean":"2024-04-27T02:34:48.882951+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-27T02:34:48.882951+0000","last_undegraded":"2024-04-27T02:34:48.882951+0000","last_fullsized":"2024-04-27T02:34:48.882951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.880073+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-27T02:34:48.880073+0000","last_peered":"2024-04-27T02:34:48.880073+0000","last_clean":"2024-04-27T02:34:48.880073+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-27T02:34:48.880073+0000","last_undegraded":"2024-04-27T02:34:48.880073+0000","last_fullsized":"2024-04-27T02:34:48.880073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882868+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-27T02:34:48.882868+0000","last_peered":"2024-04-27T02:34:48.882868+0000","last_clean":"2024-04-27T02:34:48.882868+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-27T02:34:48.882868+0000","last_undegraded":"2024-04-27T02:34:48.882868+0000","last_fullsized":"2024-04-27T02:34:48.882868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.868983+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-27T02:34:48.868983+0000","last_peered":"2024-04-27T02:34:48.868983+0000","last_clean":"2024-04-27T02:34:48.868983+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-27T02:34:48.868983+0000","last_undegraded":"2024-04-27T02:34:48.868983+0000","last_fullsized":"2024-04-27T02:34:48.868983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.169172+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-27T02:34:04.169172+0000","last_peered":"2024-04-27T02:34:04.169172+0000","last_clean":"2024-04-27T02:34:04.169172+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-27T02:34:04.169172+0000","last_undegraded":"2024-04-27T02:34:04.169172+0000","last_fullsized":"2024-04-27T02:34:04.169172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"22'3","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895751+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-27T02:36:03.895751+0000","last_peered":"2024-04-27T02:36:03.895751+0000","last_clean":"2024-04-27T02:36:03.895751+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-27T02:36:03.895751+0000","last_undegraded":"2024-04-27T02:36:03.895751+0000","last_fullsized":"2024-04-27T02:36:03.895751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895708+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-27T02:36:03.895708+0000","last_peered":"2024-04-27T02:36:03.895708+0000","last_clean":"2024-04-27T02:36:03.895708+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-27T02:36:03.895708+0000","last_undegraded":"2024-04-27T02:36:03.895708+0000","last_fullsized":"2024-04-27T02:36:03.895708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895675+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-27T02:36:03.895675+0000","last_peered":"2024-04-27T02:36:03.895675+0000","last_clean":"2024-04-27T02:36:03.895675+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-27T02:36:03.895675+0000","last_undegraded":"2024-04-27T02:36:03.895675+0000","last_fullsized":"2024-04-27T02:36:03.895675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886609+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-27T02:36:03.886609+0000","last_peered":"2024-04-27T02:36:03.886609+0000","last_clean":"2024-04-27T02:36:03.886609+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-27T02:36:03.886609+0000","last_undegraded":"2024-04-27T02:36:03.886609+0000","last_fullsized":"2024-04-27T02:36:03.886609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.876176+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-27T02:34:58.876176+0000","last_peered":"2024-04-27T02:34:58.876176+0000","last_clean":"2024-04-27T02:34:58.876176+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-27T02:34:58.876176+0000","last_undegraded":"2024-04-27T02:34:58.876176+0000","last_fullsized":"2024-04-27T02:34:58.876176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.176263+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-27T02:34:29.176263+0000","last_peered":"2024-04-27T02:34:29.176263+0000","last_clean":"2024-04-27T02:34:29.176263+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-27T02:34:29.176263+0000","last_undegraded":"2024-04-27T02:34:29.176263+0000","last_fullsized":"2024-04-27T02:34:29.176263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187913+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-27T02:34:29.187913+0000","last_peered":"2024-04-27T02:34:29.187913+0000","last_clean":"2024-04-27T02:34:29.187913+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-27T02:34:29.187913+0000","last_undegraded":"2024-04-27T02:34:29.187913+0000","last_fullsized":"2024-04-27T02:34:29.187913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:13.749278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.188052+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-27T02:34:29.188052+0000","last_peered":"2024-04-27T02:34:29.188052+0000","last_clean":"2024-04-27T02:34:29.188052+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-27T02:34:29.188052+0000","last_undegraded":"2024-04-27T02:34:29.188052+0000","last_fullsized":"2024-04-27T02:34:29.188052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:37.828024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158366+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-27T02:34:29.158366+0000","last_peered":"2024-04-27T02:34:29.158366+0000","last_clean":"2024-04-27T02:34:29.158366+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-27T02:34:29.158366+0000","last_undegraded":"2024-04-27T02:34:29.158366+0000","last_fullsized":"2024-04-27T02:34:29.158366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.889371+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-27T02:35:18.889371+0000","last_peered":"2024-04-27T02:35:18.889371+0000","last_clean":"2024-04-27T02:35:18.889371+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-27T02:35:18.889371+0000","last_undegraded":"2024-04-27T02:35:18.889371+0000","last_fullsized":"2024-04-27T02:35:18.889371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:09.342327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"22'1","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.882992+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-27T02:34:48.882992+0000","last_peered":"2024-04-27T02:34:48.882992+0000","last_clean":"2024-04-27T02:34:48.882992+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-27T02:34:48.882992+0000","last_undegraded":"2024-04-27T02:34:48.882992+0000","last_fullsized":"2024-04-27T02:34:48.882992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"22'3","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877811+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-27T02:34:48.877811+0000","last_peered":"2024-04-27T02:34:48.877811+0000","last_clean":"2024-04-27T02:34:48.877811+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-27T02:34:48.877811+0000","last_undegraded":"2024-04-27T02:34:48.877811+0000","last_fullsized":"2024-04-27T02:34:48.877811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"22'1","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877782+0000","last_change":"2024-04-26T23:34:46.096164+0000","last_active":"2024-04-27T02:34:48.877782+0000","last_peered":"2024-04-27T02:34:48.877782+0000","last_clean":"2024-04-27T02:34:48.877782+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-27T02:34:48.877782+0000","last_undegraded":"2024-04-27T02:34:48.877782+0000","last_fullsized":"2024-04-27T02:34:48.877782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869060+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-27T02:34:48.869060+0000","last_peered":"2024-04-27T02:34:48.869060+0000","last_clean":"2024-04-27T02:34:48.869060+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-27T02:34:48.869060+0000","last_undegraded":"2024-04-27T02:34:48.869060+0000","last_fullsized":"2024-04-27T02:34:48.869060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"22'5","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.887661+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-27T02:35:08.887661+0000","last_peered":"2024-04-27T02:35:08.887661+0000","last_clean":"2024-04-27T02:35:08.887661+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-27T02:35:08.887661+0000","last_undegraded":"2024-04-27T02:35:08.887661+0000","last_fullsized":"2024-04-27T02:35:08.887661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:33:56.509478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.867416+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-27T02:34:38.867416+0000","last_peered":"2024-04-27T02:34:38.867416+0000","last_clean":"2024-04-27T02:34:38.867416+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-27T02:34:38.867416+0000","last_undegraded":"2024-04-27T02:34:38.867416+0000","last_fullsized":"2024-04-27T02:34:38.867416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:42.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.878566+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-27T02:34:38.878566+0000","last_peered":"2024-04-27T02:34:38.878566+0000","last_clean":"2024-04-27T02:34:38.878566+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-27T02:34:38.878566+0000","last_undegraded":"2024-04-27T02:34:38.878566+0000","last_fullsized":"2024-04-27T02:34:38.878566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873079+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-27T02:34:38.873079+0000","last_peered":"2024-04-27T02:34:38.873079+0000","last_clean":"2024-04-27T02:34:38.873079+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-27T02:34:38.873079+0000","last_undegraded":"2024-04-27T02:34:38.873079+0000","last_fullsized":"2024-04-27T02:34:38.873079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873013+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-27T02:34:38.873013+0000","last_peered":"2024-04-27T02:34:38.873013+0000","last_clean":"2024-04-27T02:34:38.873013+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-27T02:34:38.873013+0000","last_undegraded":"2024-04-27T02:34:38.873013+0000","last_fullsized":"2024-04-27T02:34:38.873013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.175396+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-27T02:34:24.175396+0000","last_peered":"2024-04-27T02:34:24.175396+0000","last_clean":"2024-04-27T02:34:24.175396+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-27T02:34:24.175396+0000","last_undegraded":"2024-04-27T02:34:24.175396+0000","last_fullsized":"2024-04-27T02:34:24.175396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:54.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896455+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-27T02:36:03.896455+0000","last_peered":"2024-04-27T02:36:03.896455+0000","last_clean":"2024-04-27T02:36:03.896455+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-27T02:36:03.896455+0000","last_undegraded":"2024-04-27T02:36:03.896455+0000","last_fullsized":"2024-04-27T02:36:03.896455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:08.521178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882856+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-27T02:36:03.882856+0000","last_peered":"2024-04-27T02:36:03.882856+0000","last_clean":"2024-04-27T02:36:03.882856+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-27T02:36:03.882856+0000","last_undegraded":"2024-04-27T02:36:03.882856+0000","last_fullsized":"2024-04-27T02:36:03.882856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.891627+0000","last_change":"2024-04-26T23:34:46.098997+0000","last_active":"2024-04-27T02:36:03.891627+0000","last_peered":"2024-04-27T02:36:03.891627+0000","last_clean":"2024-04-27T02:36:03.891627+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-27T02:36:03.891627+0000","last_undegraded":"2024-04-27T02:36:03.891627+0000","last_fullsized":"2024-04-27T02:36:03.891627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877841+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-27T02:34:48.877841+0000","last_peered":"2024-04-27T02:34:48.877841+0000","last_clean":"2024-04-27T02:34:48.877841+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-27T02:34:48.877841+0000","last_undegraded":"2024-04-27T02:34:48.877841+0000","last_fullsized":"2024-04-27T02:34:48.877841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869110+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-27T02:34:48.869110+0000","last_peered":"2024-04-27T02:34:48.869110+0000","last_clean":"2024-04-27T02:34:48.869110+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-27T02:34:48.869110+0000","last_undegraded":"2024-04-27T02:34:48.869110+0000","last_fullsized":"2024-04-27T02:34:48.869110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877875+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-27T02:34:48.877875+0000","last_peered":"2024-04-27T02:34:48.877875+0000","last_clean":"2024-04-27T02:34:48.877875+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-27T02:34:48.877875+0000","last_undegraded":"2024-04-27T02:34:48.877875+0000","last_fullsized":"2024-04-27T02:34:48.877875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884228+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-27T02:34:48.884228+0000","last_peered":"2024-04-27T02:34:48.884228+0000","last_clean":"2024-04-27T02:34:48.884228+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-27T02:34:48.884228+0000","last_undegraded":"2024-04-27T02:34:48.884228+0000","last_fullsized":"2024-04-27T02:34:48.884228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.166242+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-27T02:34:04.166242+0000","last_peered":"2024-04-27T02:34:04.166242+0000","last_clean":"2024-04-27T02:34:04.166242+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-27T02:34:04.166242+0000","last_undegraded":"2024-04-27T02:34:04.166242+0000","last_fullsized":"2024-04-27T02:34:04.166242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881735+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-27T02:36:03.881735+0000","last_peered":"2024-04-27T02:36:03.881735+0000","last_clean":"2024-04-27T02:36:03.881735+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-27T02:36:03.881735+0000","last_undegraded":"2024-04-27T02:36:03.881735+0000","last_fullsized":"2024-04-27T02:36:03.881735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:34.359270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896414+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-27T02:36:03.896414+0000","last_peered":"2024-04-27T02:36:03.896414+0000","last_clean":"2024-04-27T02:36:03.896414+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-27T02:36:03.896414+0000","last_undegraded":"2024-04-27T02:36:03.896414+0000","last_fullsized":"2024-04-27T02:36:03.896414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.165505+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-27T02:34:04.165505+0000","last_peered":"2024-04-27T02:34:04.165505+0000","last_clean":"2024-04-27T02:34:04.165505+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-27T02:34:04.165505+0000","last_undegraded":"2024-04-27T02:34:04.165505+0000","last_fullsized":"2024-04-27T02:34:04.165505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889946+0000","last_change":"2024-04-26T23:34:45.074623+0000","last_active":"2024-04-27T02:36:03.889946+0000","last_peered":"2024-04-27T02:36:03.889946+0000","last_clean":"2024-04-27T02:36:03.889946+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-27T02:36:03.889946+0000","last_undegraded":"2024-04-27T02:36:03.889946+0000","last_fullsized":"2024-04-27T02:36:03.889946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.891680+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-27T02:36:03.891680+0000","last_peered":"2024-04-27T02:36:03.891680+0000","last_clean":"2024-04-27T02:36:03.891680+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-27T02:36:03.891680+0000","last_undegraded":"2024-04-27T02:36:03.891680+0000","last_fullsized":"2024-04-27T02:36:03.891680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895771+0000","last_change":"2024-04-26T23:34:45.073763+0000","last_active":"2024-04-27T02:36:03.895771+0000","last_peered":"2024-04-27T02:36:03.895771+0000","last_clean":"2024-04-27T02:36:03.895771+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-27T02:36:03.895771+0000","last_undegraded":"2024-04-27T02:36:03.895771+0000","last_fullsized":"2024-04-27T02:36:03.895771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:07.508274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881878+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-27T02:36:03.881878+0000","last_peered":"2024-04-27T02:36:03.881878+0000","last_clean":"2024-04-27T02:36:03.881878+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-27T02:36:03.881878+0000","last_undegraded":"2024-04-27T02:36:03.881878+0000","last_fullsized":"2024-04-27T02:36:03.881878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:03.486450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882929+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-27T02:36:03.882929+0000","last_peered":"2024-04-27T02:36:03.882929+0000","last_clean":"2024-04-27T02:36:03.882929+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-27T02:36:03.882929+0000","last_undegraded":"2024-04-27T02:36:03.882929+0000","last_fullsized":"2024-04-27T02:36:03.882929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.886165+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-27T02:34:58.886165+0000","last_peered":"2024-04-27T02:34:58.886165+0000","last_clean":"2024-04-27T02:34:58.886165+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-27T02:34:58.886165+0000","last_undegraded":"2024-04-27T02:34:58.886165+0000","last_fullsized":"2024-04-27T02:34:58.886165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:03.761817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'55","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.881588+0000","last_change":"2024-04-26T23:34:45.074276+0000","last_active":"2024-04-27T02:34:58.881588+0000","last_peered":"2024-04-27T02:34:58.881588+0000","last_clean":"2024-04-27T02:34:58.881588+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-27T02:34:58.881588+0000","last_undegraded":"2024-04-27T02:34:58.881588+0000","last_fullsized":"2024-04-27T02:34:58.881588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:33.430917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199217,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895730+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-27T02:36:03.895730+0000","last_peered":"2024-04-27T02:36:03.895730+0000","last_clean":"2024-04-27T02:36:03.895730+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-27T02:36:03.895730+0000","last_undegraded":"2024-04-27T02:36:03.895730+0000","last_fullsized":"2024-04-27T02:36:03.895730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158273+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-27T02:34:29.158273+0000","last_peered":"2024-04-27T02:34:29.158273+0000","last_clean":"2024-04-27T02:34:29.158273+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-27T02:34:29.158273+0000","last_undegraded":"2024-04-27T02:34:29.158273+0000","last_fullsized":"2024-04-27T02:34:29.158273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.170403+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-27T02:34:29.170403+0000","last_peered":"2024-04-27T02:34:29.170403+0000","last_clean":"2024-04-27T02:34:29.170403+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-27T02:34:29.170403+0000","last_undegraded":"2024-04-27T02:34:29.170403+0000","last_fullsized":"2024-04-27T02:34:29.170403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187994+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-27T02:34:29.187994+0000","last_peered":"2024-04-27T02:34:29.187994+0000","last_clean":"2024-04-27T02:34:29.187994+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-27T02:34:29.187994+0000","last_undegraded":"2024-04-27T02:34:29.187994+0000","last_fullsized":"2024-04-27T02:34:29.187994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:49.953845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.188014+0000","last_change":"2024-04-26T23:34:46.093800+0000","last_active":"2024-04-27T02:34:29.188014+0000","last_peered":"2024-04-27T02:34:29.188014+0000","last_clean":"2024-04-27T02:34:29.188014+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-27T02:34:29.188014+0000","last_undegraded":"2024-04-27T02:34:29.188014+0000","last_fullsized":"2024-04-27T02:34:29.188014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:07.701378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.186924+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-27T02:34:29.186924+0000","last_peered":"2024-04-27T02:34:29.186924+0000","last_clean":"2024-04-27T02:34:29.186924+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-27T02:34:29.186924+0000","last_undegraded":"2024-04-27T02:34:29.186924+0000","last_fullsized":"2024-04-27T02:34:29.186924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.173518+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-27T02:34:29.173518+0000","last_peered":"2024-04-27T02:34:29.173518+0000","last_clean":"2024-04-27T02:34:29.173518+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-27T02:34:29.173518+0000","last_undegraded":"2024-04-27T02:34:29.173518+0000","last_fullsized":"2024-04-27T02:34:29.173518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:08.523129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.169460+0000","last_change":"2024-04-26T23:34:45.072379+0000","last_active":"2024-04-27T02:34:29.169460+0000","last_peered":"2024-04-27T02:34:29.169460+0000","last_clean":"2024-04-27T02:34:29.169460+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-27T02:34:29.169460+0000","last_undegraded":"2024-04-27T02:34:29.169460+0000","last_fullsized":"2024-04-27T02:34:29.169460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.187961+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-27T02:34:29.187961+0000","last_peered":"2024-04-27T02:34:29.187961+0000","last_clean":"2024-04-27T02:34:29.187961+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-27T02:34:29.187961+0000","last_undegraded":"2024-04-27T02:34:29.187961+0000","last_fullsized":"2024-04-27T02:34:29.187961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:15.551685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.888296+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-27T02:35:18.888296+0000","last_peered":"2024-04-27T02:35:18.888296+0000","last_clean":"2024-04-27T02:35:18.888296+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-27T02:35:18.888296+0000","last_undegraded":"2024-04-27T02:35:18.888296+0000","last_fullsized":"2024-04-27T02:35:18.888296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.880158+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-27T02:34:48.880158+0000","last_peered":"2024-04-27T02:34:48.880158+0000","last_clean":"2024-04-27T02:34:48.880158+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-27T02:34:48.880158+0000","last_undegraded":"2024-04-27T02:34:48.880158+0000","last_fullsized":"2024-04-27T02:34:48.880158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877924+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-27T02:34:48.877924+0000","last_peered":"2024-04-27T02:34:48.877924+0000","last_clean":"2024-04-27T02:34:48.877924+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-27T02:34:48.877924+0000","last_undegraded":"2024-04-27T02:34:48.877924+0000","last_fullsized":"2024-04-27T02:34:48.877924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:48.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.888247+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-27T02:35:18.888247+0000","last_peered":"2024-04-27T02:35:18.888247+0000","last_clean":"2024-04-27T02:35:18.888247+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-27T02:35:18.888247+0000","last_undegraded":"2024-04-27T02:35:18.888247+0000","last_fullsized":"2024-04-27T02:35:18.888247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.869159+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-27T02:34:48.869159+0000","last_peered":"2024-04-27T02:34:48.869159+0000","last_clean":"2024-04-27T02:34:48.869159+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-27T02:34:48.869159+0000","last_undegraded":"2024-04-27T02:34:48.869159+0000","last_fullsized":"2024-04-27T02:34:48.869159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883029+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-27T02:34:48.883029+0000","last_peered":"2024-04-27T02:34:48.883029+0000","last_clean":"2024-04-27T02:34:48.883029+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-27T02:34:48.883029+0000","last_undegraded":"2024-04-27T02:34:48.883029+0000","last_fullsized":"2024-04-27T02:34:48.883029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.874659+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-27T02:34:48.874659+0000","last_peered":"2024-04-27T02:34:48.874659+0000","last_clean":"2024-04-27T02:34:48.874659+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-27T02:34:48.874659+0000","last_undegraded":"2024-04-27T02:34:48.874659+0000","last_fullsized":"2024-04-27T02:34:48.874659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884327+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-27T02:34:48.884327+0000","last_peered":"2024-04-27T02:34:48.884327+0000","last_clean":"2024-04-27T02:34:48.884327+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-27T02:34:48.884327+0000","last_undegraded":"2024-04-27T02:34:48.884327+0000","last_fullsized":"2024-04-27T02:34:48.884327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:40:10.277157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'161","reported_seq":318,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:13.881887+0000","last_change":"2024-04-26T23:34:41.212862+0000","last_active":"2024-04-27T02:35:13.881887+0000","last_peered":"2024-04-27T02:35:13.881887+0000","last_clean":"2024-04-27T02:35:13.881887+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-27T02:35:13.881887+0000","last_undegraded":"2024-04-27T02:35:13.881887+0000","last_fullsized":"2024-04-27T02:35:13.881887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:39.876770+0000","last_clean_scrub_stamp":"2024-04-26T23:34:39.876770+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:44.232023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896518+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-27T02:36:03.896518+0000","last_peered":"2024-04-27T02:36:03.896518+0000","last_clean":"2024-04-27T02:36:03.896518+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-27T02:36:03.896518+0000","last_undegraded":"2024-04-27T02:36:03.896518+0000","last_fullsized":"2024-04-27T02:36:03.896518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:35.809938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889767+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-27T02:36:03.889767+0000","last_peered":"2024-04-27T02:36:03.889767+0000","last_clean":"2024-04-27T02:36:03.889767+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-27T02:36:03.889767+0000","last_undegraded":"2024-04-27T02:36:03.889767+0000","last_fullsized":"2024-04-27T02:36:03.889767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.889297+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-27T02:35:18.889297+0000","last_peered":"2024-04-27T02:35:18.889297+0000","last_clean":"2024-04-27T02:35:18.889297+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-27T02:35:18.889297+0000","last_undegraded":"2024-04-27T02:35:18.889297+0000","last_fullsized":"2024-04-27T02:35:18.889297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:10.337570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886561+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-27T02:36:03.886561+0000","last_peered":"2024-04-27T02:36:03.886561+0000","last_clean":"2024-04-27T02:36:03.886561+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-27T02:36:03.886561+0000","last_undegraded":"2024-04-27T02:36:03.886561+0000","last_fullsized":"2024-04-27T02:36:03.886561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882893+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-27T02:36:03.882893+0000","last_peered":"2024-04-27T02:36:03.882893+0000","last_clean":"2024-04-27T02:36:03.882893+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-27T02:36:03.882893+0000","last_undegraded":"2024-04-27T02:36:03.882893+0000","last_fullsized":"2024-04-27T02:36:03.882893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":1,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"22'2","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874268+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-27T02:35:18.874268+0000","last_peered":"2024-04-27T02:35:18.874268+0000","last_clean":"2024-04-27T02:35:18.874268+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-27T02:35:18.874268+0000","last_undegraded":"2024-04-27T02:35:18.874268+0000","last_fullsized":"2024-04-27T02:35:18.874268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:14.697898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.896490+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-27T02:36:03.896490+0000","last_peered":"2024-04-27T02:36:03.896490+0000","last_clean":"2024-04-27T02:36:03.896490+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-27T02:36:03.896490+0000","last_undegraded":"2024-04-27T02:36:03.896490+0000","last_fullsized":"2024-04-27T02:36:03.896490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:21.723421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.895639+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-27T02:36:03.895639+0000","last_peered":"2024-04-27T02:36:03.895639+0000","last_clean":"2024-04-27T02:36:03.895639+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-27T02:36:03.895639+0000","last_undegraded":"2024-04-27T02:36:03.895639+0000","last_fullsized":"2024-04-27T02:36:03.895639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:53.285097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881786+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-27T02:36:03.881786+0000","last_peered":"2024-04-27T02:36:03.881786+0000","last_clean":"2024-04-27T02:36:03.881786+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-27T02:36:03.881786+0000","last_undegraded":"2024-04-27T02:36:03.881786+0000","last_fullsized":"2024-04-27T02:36:03.881786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'3","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.171989+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-27T02:34:24.171989+0000","last_peered":"2024-04-27T02:34:24.171989+0000","last_clean":"2024-04-27T02:34:24.171989+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-27T02:34:24.171989+0000","last_undegraded":"2024-04-27T02:34:24.171989+0000","last_fullsized":"2024-04-27T02:34:24.171989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:24.186989+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-27T02:34:24.186989+0000","last_peered":"2024-04-27T02:34:24.186989+0000","last_clean":"2024-04-27T02:34:24.186989+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-27T02:34:24.186989+0000","last_undegraded":"2024-04-27T02:34:24.186989+0000","last_fullsized":"2024-04-27T02:34:24.186989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:33.819205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886639+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-27T02:36:03.886639+0000","last_peered":"2024-04-27T02:36:03.886639+0000","last_clean":"2024-04-27T02:36:03.886639+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-27T02:36:03.886639+0000","last_undegraded":"2024-04-27T02:36:03.886639+0000","last_fullsized":"2024-04-27T02:36:03.886639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'5","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.876020+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-27T02:34:38.876020+0000","last_peered":"2024-04-27T02:34:38.876020+0000","last_clean":"2024-04-27T02:34:38.876020+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-27T02:34:38.876020+0000","last_undegraded":"2024-04-27T02:34:38.876020+0000","last_fullsized":"2024-04-27T02:34:38.876020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'4","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.876040+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-27T02:34:38.876040+0000","last_peered":"2024-04-27T02:34:38.876040+0000","last_clean":"2024-04-27T02:34:38.876040+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-27T02:34:38.876040+0000","last_undegraded":"2024-04-27T02:34:38.876040+0000","last_fullsized":"2024-04-27T02:34:38.876040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:59.683408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'3","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.882669+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-27T02:34:38.882669+0000","last_peered":"2024-04-27T02:34:38.882669+0000","last_clean":"2024-04-27T02:34:38.882669+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-27T02:34:38.882669+0000","last_undegraded":"2024-04-27T02:34:38.882669+0000","last_fullsized":"2024-04-27T02:34:38.882669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:19.687355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875998+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-27T02:34:38.875998+0000","last_peered":"2024-04-27T02:34:38.875998+0000","last_clean":"2024-04-27T02:34:38.875998+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-27T02:34:38.875998+0000","last_undegraded":"2024-04-27T02:34:38.875998+0000","last_fullsized":"2024-04-27T02:34:38.875998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.881192+0000","last_change":"2024-04-26T23:34:45.076058+0000","last_active":"2024-04-27T02:34:38.881192+0000","last_peered":"2024-04-27T02:34:38.881192+0000","last_clean":"2024-04-27T02:34:38.881192+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-27T02:34:38.881192+0000","last_undegraded":"2024-04-27T02:34:38.881192+0000","last_fullsized":"2024-04-27T02:34:38.881192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.882474+0000","last_change":"2024-04-26T23:34:46.092601+0000","last_active":"2024-04-27T02:34:38.882474+0000","last_peered":"2024-04-27T02:34:38.882474+0000","last_clean":"2024-04-27T02:34:38.882474+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-27T02:34:38.882474+0000","last_undegraded":"2024-04-27T02:34:38.882474+0000","last_fullsized":"2024-04-27T02:34:38.882474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:01.319097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875932+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-27T02:34:38.875932+0000","last_peered":"2024-04-27T02:34:38.875932+0000","last_clean":"2024-04-27T02:34:38.875932+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-27T02:34:38.875932+0000","last_undegraded":"2024-04-27T02:34:38.875932+0000","last_fullsized":"2024-04-27T02:34:38.875932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.875867+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-27T02:34:38.875867+0000","last_peered":"2024-04-27T02:34:38.875867+0000","last_clean":"2024-04-27T02:34:38.875867+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-27T02:34:38.875867+0000","last_undegraded":"2024-04-27T02:34:38.875867+0000","last_fullsized":"2024-04-27T02:34:38.875867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:42:13.095732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.877678+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-27T02:35:08.877678+0000","last_peered":"2024-04-27T02:35:08.877678+0000","last_clean":"2024-04-27T02:35:08.877678+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-27T02:35:08.877678+0000","last_undegraded":"2024-04-27T02:35:08.877678+0000","last_fullsized":"2024-04-27T02:35:08.877678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.871792+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-27T02:34:48.871792+0000","last_peered":"2024-04-27T02:34:48.871792+0000","last_clean":"2024-04-27T02:34:48.871792+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-27T02:34:48.871792+0000","last_undegraded":"2024-04-27T02:34:48.871792+0000","last_fullsized":"2024-04-27T02:34:48.871792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884278+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-27T02:34:48.884278+0000","last_peered":"2024-04-27T02:34:48.884278+0000","last_clean":"2024-04-27T02:34:48.884278+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-27T02:34:48.884278+0000","last_undegraded":"2024-04-27T02:34:48.884278+0000","last_fullsized":"2024-04-27T02:34:48.884278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:35.702135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.887716+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-27T02:35:08.887716+0000","last_peered":"2024-04-27T02:35:08.887716+0000","last_clean":"2024-04-27T02:35:08.887716+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-27T02:35:08.887716+0000","last_undegraded":"2024-04-27T02:35:08.887716+0000","last_fullsized":"2024-04-27T02:35:08.887716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:37.441468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.884310+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-27T02:34:48.884310+0000","last_peered":"2024-04-27T02:34:48.884310+0000","last_clean":"2024-04-27T02:34:48.884310+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-27T02:34:48.884310+0000","last_undegraded":"2024-04-27T02:34:48.884310+0000","last_fullsized":"2024-04-27T02:34:48.884310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:32.995931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883060+0000","last_change":"2024-04-26T23:34:45.075234+0000","last_active":"2024-04-27T02:34:48.883060+0000","last_peered":"2024-04-27T02:34:48.883060+0000","last_clean":"2024-04-27T02:34:48.883060+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-27T02:34:48.883060+0000","last_undegraded":"2024-04-27T02:34:48.883060+0000","last_fullsized":"2024-04-27T02:34:48.883060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:44.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.877876+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-27T02:34:48.877876+0000","last_peered":"2024-04-27T02:34:48.877876+0000","last_clean":"2024-04-27T02:34:48.877876+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-27T02:34:48.877876+0000","last_undegraded":"2024-04-27T02:34:48.877876+0000","last_fullsized":"2024-04-27T02:34:48.877876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:50.968700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.883144+0000","last_change":"2024-04-26T23:34:45.074596+0000","last_active":"2024-04-27T02:34:48.883144+0000","last_peered":"2024-04-27T02:34:48.883144+0000","last_clean":"2024-04-27T02:34:48.883144+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-27T02:34:48.883144+0000","last_undegraded":"2024-04-27T02:34:48.883144+0000","last_fullsized":"2024-04-27T02:34:48.883144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:05.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.881855+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-27T02:36:03.881855+0000","last_peered":"2024-04-27T02:36:03.881855+0000","last_clean":"2024-04-27T02:36:03.881855+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-27T02:36:03.881855+0000","last_undegraded":"2024-04-27T02:36:03.881855+0000","last_fullsized":"2024-04-27T02:36:03.881855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874398+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-27T02:35:18.874398+0000","last_peered":"2024-04-27T02:35:18.874398+0000","last_clean":"2024-04-27T02:35:18.874398+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-27T02:35:18.874398+0000","last_undegraded":"2024-04-27T02:35:18.874398+0000","last_fullsized":"2024-04-27T02:35:18.874398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:18.874378+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-27T02:35:18.874378+0000","last_peered":"2024-04-27T02:35:18.874378+0000","last_clean":"2024-04-27T02:35:18.874378+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-27T02:35:18.874378+0000","last_undegraded":"2024-04-27T02:35:18.874378+0000","last_fullsized":"2024-04-27T02:35:18.874378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:22:09.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.889818+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-27T02:36:03.889818+0000","last_peered":"2024-04-27T02:36:03.889818+0000","last_clean":"2024-04-27T02:36:03.889818+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-27T02:36:03.889818+0000","last_undegraded":"2024-04-27T02:36:03.889818+0000","last_fullsized":"2024-04-27T02:36:03.889818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:42.376252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":202439,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":102,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":404878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834577058,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":85395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834577057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":229376,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834577057,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":839680,"data_stored":675739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834577057,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":446464,"data_stored":282736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834577057,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":83437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834577057,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":438272,"data_stored":282064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834577057,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":827392,"data_stored":673285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834577057,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":199217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-27T02:38:37.877 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-27T02:38:38.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.156+0000 7f649ac00640 1 Processor -- start 2024-04-27T02:38:38.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.156+0000 7f649ac00640 1 -- start start 2024-04-27T02:38:38.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.157+0000 7f649ac00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f64940bbc30 0x7f6494148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.157+0000 7f649ac00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6494073420 0x7f6494073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.157+0000 7f649ac00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64940bc010 con 0x7f64940bd7a0 2024-04-27T02:38:38.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.157+0000 7f649ac00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f6494149220 con 0x7f6494073420 2024-04-27T02:38:38.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.157+0000 7f649ac00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6494148220 con 0x7f64940bbc30 2024-04-27T02:38:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6498e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f64940bd7a0 0x7f64940baa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47356/0 (socket says 172.21.15.16:47356) 2024-04-27T02:38:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6498e00640 1 -- 172.21.15.16:0/458647345 learned_addr learned my addr 172.21.15.16:0/458647345 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6499800640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f64940bbc30 0x7f6494148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f649a200640 1 --2- 172.21.15.16:0/458647345 >> v2:172.21.15.32:3300/0 conn(0x7f6494073420 0x7f6494073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557910451 0 0) 0x7f64940bc010 con 0x7f64940bd7a0 2024-04-27T02:38:38.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f647c003520 con 0x7f64940bd7a0 2024-04-27T02:38:38.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3076334285 0 0) 0x7f647c003520 con 0x7f64940bd7a0 2024-04-27T02:38:38.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f64940bbc30 msgr2=0x7f6494148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:38.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.158+0000 7f6493e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f64940bbc30 0x7f6494148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 >> v2:172.21.15.32:3300/0 conn(0x7f6494073420 msgr2=0x7f6494073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:38.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 --2- 172.21.15.16:0/458647345 >> v2:172.21.15.32:3300/0 conn(0x7f6494073420 0x7f6494073cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64941484e0 con 0x7f64940bd7a0 2024-04-27T02:38:38.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f6480001670 con 0x7f64940bd7a0 2024-04-27T02:38:38.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 >> v1:172.21.15.16:6789/0 conn(0x7f64940bd7a0 legacy=0x7f64940baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:38.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f647c0039b0 0x7f647c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c004800 0x7f647c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f64940bbc30 0x7f647c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6494149220 con 0x7f647c004800 2024-04-27T02:38:38.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f6494148220 con 0x7f647c0039b0 2024-04-27T02:38:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f647c00bba0 con 0x7f64940bbc30 2024-04-27T02:38:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6498e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c004800 0x7f647c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6499800640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f647c0039b0 0x7f647c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6498e00640 1 -- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f64940bbc30 msgr2=0x7f647c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6498e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f64940bbc30 0x7f647c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6498e00640 1 -- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f647c0039b0 msgr2=0x7f647c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6498e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f647c0039b0 0x7f647c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.159+0000 7f6498e00640 1 -- 172.21.15.16:0/458647345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c003520 con 0x7f647c004800 2024-04-27T02:38:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.160+0000 7f6498e00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c004800 0x7f647c004c80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f648000c240 tx=0x7f647c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed8c03c750a4e1f server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648002e070 con 0x7f647c004800 2024-04-27T02:38:38.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6480005af0 con 0x7f647c004800 2024-04-27T02:38:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f6493e00640 1 -- 172.21.15.16:0/458647345 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480007d30 con 0x7f647c004800 2024-04-27T02:38:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f649ac00640 1 -- 172.21.15.16:0/458647345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c004800 msgr2=0x7f647c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f649ac00640 1 --2- 172.21.15.16:0/458647345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c004800 0x7f647c004c80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f648000c240 tx=0x7f647c005830 comp rx=0 tx=0).stop 2024-04-27T02:38:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f649a200640 1 -- 172.21.15.16:0/458647345 reap_dead start 2024-04-27T02:38:38.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f649ac00640 1 -- 172.21.15.16:0/458647345 shutdown_connections 2024-04-27T02:38:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.161+0000 7f649ac00640 1 -- 172.21.15.16:0/458647345 >> 172.21.15.16:0/458647345 conn(0x7f649409fc60 msgr2=0x7f64940a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.162+0000 7f649ac00640 1 -- 172.21.15.16:0/458647345 shutdown_connections 2024-04-27T02:38:38.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.162+0000 7f649ac00640 1 -- 172.21.15.16:0/458647345 wait complete. 2024-04-27T02:38:38.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.163+0000 7f649ac00640 1 Processor -- start 2024-04-27T02:38:38.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.163+0000 7f649ac00640 1 -- start start 2024-04-27T02:38:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f649ac00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f647c004800 0x7f64941d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f649ac00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64940b5e40 0x7f64941496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f649ac00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6494149c00 0x7f6494140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f649ac00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6494148e60 con 0x7f64940b5e40 2024-04-27T02:38:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f649ac00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f6494148ce0 con 0x7f6494149c00 2024-04-27T02:38:38.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f649ac00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6494148fe0 con 0x7f647c004800 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f6498e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64940b5e40 0x7f64941496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.164+0000 7f6498e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64940b5e40 0x7f64941496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38532/0 (socket says 172.21.15.16:38532) 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6498e00640 1 -- 172.21.15.16:0/674625660 learned_addr learned my addr 172.21.15.16:0/674625660 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f649a200640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6494149c00 0x7f6494140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6499800640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f647c004800 0x7f64941d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6498e00640 1 -- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f647c004800 msgr2=0x7f64941d3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6498e00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f647c004800 0x7f64941d3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6498e00640 1 -- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6494149c00 msgr2=0x7f6494140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6498e00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6494149c00 0x7f6494140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6498e00640 1 -- 172.21.15.16:0/674625660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64940b6320 con 0x7f64940b5e40 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6498e00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64940b5e40 0x7f64941496c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6480001970 tx=0x7f64941486b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.165+0000 7f6491600640 1 -- 172.21.15.16:0/674625660 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480042070 con 0x7f64940b5e40 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.166+0000 7f6491600640 1 -- 172.21.15.16:0/674625660 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6480007480 con 0x7f64940b5e40 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.166+0000 7f6491600640 1 -- 172.21.15.16:0/674625660 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480001c70 con 0x7f64940b5e40 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.166+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64940b51b0 con 0x7f64940b5e40 2024-04-27T02:38:38.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.166+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64940baa10 con 0x7f64940b5e40 2024-04-27T02:38:38.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.167+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64940b4fe0 con 0x7f64940b5e40 2024-04-27T02:38:38.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.168+0000 7f6491600640 1 -- 172.21.15.16:0/674625660 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6480045070 con 0x7f64940b5e40 2024-04-27T02:38:38.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.169+0000 7f6491600640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f647406c920 0x7f647406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:38.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.169+0000 7f6491600640 1 -- 172.21.15.16:0/674625660 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f64800ac5c0 con 0x7f64940b5e40 2024-04-27T02:38:38.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.169+0000 7f6499800640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f647406c920 0x7f647406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:38.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.170+0000 7f6499800640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f647406c920 0x7f647406ede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6488006fd0 tx=0x7f6488008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:38.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.173+0000 7f6491600640 1 -- 172.21.15.16:0/674625660 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f648007ab00 con 0x7f64940b5e40 2024-04-27T02:38:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.382+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6494076600 con 0x7f64940b5e40 2024-04-27T02:38:38.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.386+0000 7f6491600640 1 -- 172.21.15.16:0/674625660 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16610 (secure 0 0 0) 0x7f648007a400 con 0x7f64940b5e40 2024-04-27T02:38:38.360 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:38:38.360 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:35:33.285268+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T02:38:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f647406c920 msgr2=0x7f647406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f647406c920 0x7f647406ede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6488006fd0 tx=0x7f6488008040 comp rx=0 tx=0).stop 2024-04-27T02:38:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64940b5e40 msgr2=0x7f64941496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64940b5e40 0x7f64941496c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6480001970 tx=0x7f64941486b0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 shutdown_connections 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f647406c920 0x7f647406ede0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6494149c00 0x7f6494140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64940b5e40 0x7f64941496c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 --2- 172.21.15.16:0/674625660 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f647c004800 0x7f64941d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 >> 172.21.15.16:0/674625660 conn(0x7f649409fc60 msgr2=0x7f6494146bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 shutdown_connections 2024-04-27T02:38:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:38.388+0000 7f649ac00640 1 -- 172.21.15.16:0/674625660 wait complete. 2024-04-27T02:38:39.382 INFO:tasks.ceph:Scrubbing osd.0 2024-04-27T02:38:39.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:39.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.637+0000 7fd611a00640 1 Processor -- start 2024-04-27T02:38:39.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.637+0000 7fd611a00640 1 -- start start 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.638+0000 7fd611a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 0x7fd60c14a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd611a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0b3fa0 con 0x7fd60c09eed0 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd611a00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c09f2b0 con 0x7fd60c0b3840 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd611a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0b30f0 con 0x7fd60c0b13f0 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd60aa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd60c09eed0 0x7fd60c1499c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47372/0 (socket says 172.21.15.16:47372) 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd60aa00640 1 -- 172.21.15.16:0/2144058121 learned_addr learned my addr 172.21.15.16:0/2144058121 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741037271 0 0) 0x7fd60c0b3fa0 con 0x7fd60c09eed0 2024-04-27T02:38:39.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f0003520 con 0x7fd60c09eed0 2024-04-27T02:38:39.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.639+0000 7fd60a000640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 0x7fd60c14a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1340458504 0 0) 0x7fd5f0003520 con 0x7fd60c09eed0 2024-04-27T02:38:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 msgr2=0x7fd60c14a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 0x7fd60c14a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 >> v1:172.21.15.32:6789/0 conn(0x7fd60c0b3840 legacy=0x7fd60c150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0b1910 con 0x7fd60c09eed0 2024-04-27T02:38:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7fd5fc0019f0 con 0x7fd60c09eed0 2024-04-27T02:38:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 >> v1:172.21.15.16:6789/0 conn(0x7fd60c09eed0 legacy=0x7fd60c1499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5f00039e0 0x7fd5f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 0x7fd5f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f0004d40 0x7fd5f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f000bb50 con 0x7fd5f00039e0 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f000bd00 con 0x7fd5f0004d40 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f000bf00 con 0x7fd60c0b13f0 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd60aa00640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5f00039e0 0x7fd5f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.640+0000 7fd60a000640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 0x7fd5f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.641+0000 7fd60aa00640 1 -- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 msgr2=0x7fd5f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.641+0000 7fd60aa00640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd60c0b13f0 0x7fd5f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.641+0000 7fd60b400640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f0004d40 0x7fd5f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.641+0000 7fd60aa00640 1 -- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f0004d40 msgr2=0x7fd5f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:39.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.641+0000 7fd60aa00640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f0004d40 0x7fd5f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.641+0000 7fd60aa00640 1 -- 172.21.15.16:0/2144058121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f0003520 con 0x7fd5f00039e0 2024-04-27T02:38:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.641+0000 7fd60b400640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd5f0004d40 0x7fd5f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.642+0000 7fd60aa00640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5f00039e0 0x7fd5f0003e00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00a850 tx=0x7fd5f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1ec94b35e89558 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.642+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00a4a0 con 0x7fd5f00039e0 2024-04-27T02:38:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.642+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc02f070 con 0x7fd5f00039e0 2024-04-27T02:38:39.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.642+0000 7fd609600640 1 -- 172.21.15.16:0/2144058121 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc02bce0 con 0x7fd5f00039e0 2024-04-27T02:38:39.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.642+0000 7fd611a00640 1 -- 172.21.15.16:0/2144058121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5f00039e0 msgr2=0x7fd5f0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.642+0000 7fd611a00640 1 --2- 172.21.15.16:0/2144058121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5f00039e0 0x7fd5f0003e00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00a850 tx=0x7fd5f0005830 comp rx=0 tx=0).stop 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.642+0000 7fd60b400640 1 -- 172.21.15.16:0/2144058121 reap_dead start 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.643+0000 7fd611a00640 1 -- 172.21.15.16:0/2144058121 shutdown_connections 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.643+0000 7fd611a00640 1 -- 172.21.15.16:0/2144058121 >> 172.21.15.16:0/2144058121 conn(0x7fd60c0b9f50 msgr2=0x7fd60c0ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.643+0000 7fd611a00640 1 -- 172.21.15.16:0/2144058121 shutdown_connections 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.643+0000 7fd611a00640 1 -- 172.21.15.16:0/2144058121 wait complete. 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.644+0000 7fd611a00640 1 Processor -- start 2024-04-27T02:38:39.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.644+0000 7fd611a00640 1 -- start start 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.645+0000 7fd611a00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd5f00039e0 0x7fd60c072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.645+0000 7fd611a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd60c09c3b0 0x7fd60c1ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.645+0000 7fd611a00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60c1de510 0x7fd60c1e1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.645+0000 7fd611a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0b1030 con 0x7fd60c09c3b0 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.645+0000 7fd611a00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0b11b0 con 0x7fd60c1de510 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.645+0000 7fd611a00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c14a0d0 con 0x7fd5f00039e0 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.645+0000 7fd60a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd60c09c3b0 0x7fd60c1ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd60c09c3b0 0x7fd60c1ddfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38550/0 (socket says 172.21.15.16:38550) 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 -- 172.21.15.16:0/3890965275 learned_addr learned my addr 172.21.15.16:0/3890965275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60aa00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd5f00039e0 0x7fd60c072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 -- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd5f00039e0 msgr2=0x7fd60c072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd5f00039e0 0x7fd60c072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 -- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60c1de510 msgr2=0x7fd60c1e1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60c1de510 0x7fd60c1e1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 -- 172.21.15.16:0/3890965275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c1de990 con 0x7fd60c09c3b0 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60aa00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fd5f00039e0 0x7fd60c072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:39.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd60a000640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd60c09c3b0 0x7fd60c1ddfd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4011630 tx=0x7fd5f4011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:39.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f400f920 con 0x7fd60c09c3b0 2024-04-27T02:38:39.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f400fac0 con 0x7fd60c09c3b0 2024-04-27T02:38:39.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f400fe70 con 0x7fd60c09c3b0 2024-04-27T02:38:39.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.646+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c09c900 con 0x7fd60c09c3b0 2024-04-27T02:38:39.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.647+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c145f30 con 0x7fd60c09c3b0 2024-04-27T02:38:39.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.647+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd60c0693a0 con 0x7fd60c09c3b0 2024-04-27T02:38:39.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.649+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5f4015460 con 0x7fd60c09c3b0 2024-04-27T02:38:39.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.649+0000 7fd602a00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd5e806c8f0 0x7fd5e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.650+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7fd5f408c450 con 0x7fd60c09c3b0 2024-04-27T02:38:39.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.650+0000 7fd602a00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7fd5e8074b50 0x7fd5e8076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.650+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 --> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5e8077640 con 0x7fd5e8074b50 2024-04-27T02:38:39.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.650+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd5f4093050 con 0x7fd60c09c3b0 2024-04-27T02:38:39.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.650+0000 7fd60b400640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7fd5e8074b50 0x7fd5e8076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.650+0000 7fd60aa00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd5e806c8f0 0x7fd5e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.651+0000 7fd60b400640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7fd5e8074b50 0x7fd5e8076f70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:39.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.651+0000 7fd60aa00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd5e806c8f0 0x7fd5e806edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc033000 tx=0x7fd5fc009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:39.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.652+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== osd.0 v2:172.21.15.16:6808/2273435597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5e8077640 con 0x7fd5e8074b50 2024-04-27T02:38:39.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.666+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 --> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd60c0b8660 con 0x7fd5e8074b50 2024-04-27T02:38:39.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd602a00640 1 -- 172.21.15.16:0/3890965275 <== osd.0 v2:172.21.15.16:6808/2273435597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd60c0b8660 con 0x7fd5e8074b50 2024-04-27T02:38:39.640 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:39.641 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:39.641 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:39.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7fd5e8074b50 msgr2=0x7fd5e8076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd611a00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:6808/2273435597,v1:172.21.15.16:6809/2273435597] conn(0x7fd5e8074b50 0x7fd5e8076f70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd5e806c8f0 msgr2=0x7fd5e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd611a00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fd5e806c8f0 0x7fd5e806edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc033000 tx=0x7fd5fc009030 comp rx=0 tx=0).stop 2024-04-27T02:38:39.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd60c09c3b0 msgr2=0x7fd60c1ddfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd611a00640 1 --2- 172.21.15.16:0/3890965275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd60c09c3b0 0x7fd60c1ddfd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4011630 tx=0x7fd5f4011af0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.667+0000 7fd60b400640 1 -- 172.21.15.16:0/3890965275 reap_dead start 2024-04-27T02:38:39.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.668+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 shutdown_connections 2024-04-27T02:38:39.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.668+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 >> 172.21.15.16:0/3890965275 conn(0x7fd60c0b9f50 msgr2=0x7fd60c0b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:39.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.668+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 shutdown_connections 2024-04-27T02:38:39.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.668+0000 7fd611a00640 1 -- 172.21.15.16:0/3890965275 wait complete. 2024-04-27T02:38:39.657 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-27T02:38:39.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.886+0000 7fc08fe00640 1 Processor -- start 2024-04-27T02:38:39.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.887+0000 7fc08fe00640 1 -- start start 2024-04-27T02:38:39.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.888+0000 7fc08fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0900b6a90 0x7fc090072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.888+0000 7fc08fe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0901468d0 0x7fc090073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.888+0000 7fc08fe00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0900b6e70 con 0x7fc0900701e0 2024-04-27T02:38:39.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.888+0000 7fc08fe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc0900b3cf0 con 0x7fc0900b6a90 2024-04-27T02:38:39.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.888+0000 7fc08fe00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fc0900714b0 con 0x7fc0901468d0 2024-04-27T02:38:39.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.888+0000 7fc08ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0900b6a90 0x7fc090072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.889+0000 7fc08ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0900b6a90 0x7fc090072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38562/0 (socket says 172.21.15.16:38562) 2024-04-27T02:38:39.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.889+0000 7fc08ea00640 1 -- 172.21.15.16:0/2983904216 learned_addr learned my addr 172.21.15.16:0/2983904216 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:39.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.889+0000 7fc08ea00640 1 -- 172.21.15.16:0/2983904216 >> v2:172.21.15.32:3300/0 conn(0x7fc0901468d0 msgr2=0x7fc090073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:39.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.889+0000 7fc08ea00640 1 --2- 172.21.15.16:0/2983904216 >> v2:172.21.15.32:3300/0 conn(0x7fc0901468d0 0x7fc090073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.889+0000 7fc08ea00640 1 -- 172.21.15.16:0/2983904216 >> v1:172.21.15.32:6789/0 conn(0x7fc0900701e0 legacy=0x7fc0901461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:39.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.889+0000 7fc08ea00640 1 -- 172.21.15.16:0/2983904216 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0900b39a0 con 0x7fc0900b6a90 2024-04-27T02:38:39.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.890+0000 7fc08ea00640 1 --2- 172.21.15.16:0/2983904216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900b6a90 0x7fc090072ef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc09006ec40 tx=0x7fc08002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f63a9723299472 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:39.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.890+0000 7fc08e000640 1 -- 172.21.15.16:0/2983904216 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080037070 con 0x7fc0900b6a90 2024-04-27T02:38:39.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.890+0000 7fc08e000640 1 -- 172.21.15.16:0/2983904216 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08002ae20 con 0x7fc0900b6a90 2024-04-27T02:38:39.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.890+0000 7fc08e000640 1 -- 172.21.15.16:0/2983904216 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080032660 con 0x7fc0900b6a90 2024-04-27T02:38:39.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 -- 172.21.15.16:0/2983904216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900b6a90 msgr2=0x7fc090072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 --2- 172.21.15.16:0/2983904216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900b6a90 0x7fc090072ef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc09006ec40 tx=0x7fc08002a110 comp rx=0 tx=0).stop 2024-04-27T02:38:39.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 -- 172.21.15.16:0/2983904216 shutdown_connections 2024-04-27T02:38:39.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 --2- 172.21.15.16:0/2983904216 >> v2:172.21.15.32:3300/0 conn(0x7fc0901468d0 0x7fc090073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 --2- 172.21.15.16:0/2983904216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900b6a90 0x7fc090072ef0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 -- 172.21.15.16:0/2983904216 >> 172.21.15.16:0/2983904216 conn(0x7fc090068270 msgr2=0x7fc090068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:39.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 -- 172.21.15.16:0/2983904216 shutdown_connections 2024-04-27T02:38:39.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.891+0000 7fc08fe00640 1 -- 172.21.15.16:0/2983904216 wait complete. 2024-04-27T02:38:39.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.893+0000 7fc08fe00640 1 Processor -- start 2024-04-27T02:38:39.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.893+0000 7fc08fe00640 1 -- start start 2024-04-27T02:38:39.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900701e0 0x7fc0900b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08fe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0900b6a90 0x7fc0901df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08fe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0901468d0 0x7fc0901dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc090070770 con 0x7fc0900701e0 2024-04-27T02:38:39.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08fe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fc090073eb0 con 0x7fc0901468d0 2024-04-27T02:38:39.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08fe00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc090150a60 con 0x7fc0900b6a90 2024-04-27T02:38:39.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900701e0 0x7fc0900b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900701e0 0x7fc0900b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38572/0 (socket says 172.21.15.16:38572) 2024-04-27T02:38:39.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 -- 172.21.15.16:0/1089583241 learned_addr learned my addr 172.21.15.16:0/1089583241 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08f400640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0901468d0 0x7fc0901dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 -- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0900b6a90 msgr2=0x7fc0901df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc087e00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0900b6a90 0x7fc0901df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0900b6a90 0x7fc0901df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 -- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0901468d0 msgr2=0x7fc0901dfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0901468d0 0x7fc0901dfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08ea00640 1 -- 172.21.15.16:0/1089583241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc090150800 con 0x7fc0900701e0 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc08f400640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0901468d0 0x7fc0901dfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:39.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.894+0000 7fc087e00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0900b6a90 0x7fc0901df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:39.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.895+0000 7fc08ea00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900701e0 0x7fc0900b99c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc080000c00 tx=0x7fc0800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:39.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.895+0000 7fc086a00640 1 -- 172.21.15.16:0/1089583241 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080042070 con 0x7fc0900701e0 2024-04-27T02:38:39.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.895+0000 7fc086a00640 1 -- 172.21.15.16:0/1089583241 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08003e670 con 0x7fc0900701e0 2024-04-27T02:38:39.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.895+0000 7fc086a00640 1 -- 172.21.15.16:0/1089583241 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080037040 con 0x7fc0900701e0 2024-04-27T02:38:39.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.895+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0900aab40 con 0x7fc0900701e0 2024-04-27T02:38:39.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.895+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0900aa860 con 0x7fc0900701e0 2024-04-27T02:38:39.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.896+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc090076600 con 0x7fc0900701e0 2024-04-27T02:38:39.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.897+0000 7fc086a00640 1 -- 172.21.15.16:0/1089583241 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc080045070 con 0x7fc0900701e0 2024-04-27T02:38:39.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.898+0000 7fc086a00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc06c06c8f0 0x7fc06c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:39.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.898+0000 7fc086a00640 1 -- 172.21.15.16:0/1089583241 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7fc0800ac3b0 con 0x7fc0900701e0 2024-04-27T02:38:39.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.899+0000 7fc087e00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc06c06c8f0 0x7fc06c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:39.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.900+0000 7fc087e00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc06c06c8f0 0x7fc06c06edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0900b8110 tx=0x7fc078009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:39.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:39.904+0000 7fc086a00640 1 -- 172.21.15.16:0/1089583241 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc08007a8d0 con 0x7fc0900701e0 2024-04-27T02:38:40.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.109+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc0901df330 con 0x7fc06c06c8f0 2024-04-27T02:38:40.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.110+0000 7fc086a00640 1 -- 172.21.15.16:0/1089583241 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc0901df330 con 0x7fc06c06c8f0 2024-04-27T02:38:40.084 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-04-27T02:38:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc06c06c8f0 msgr2=0x7fc06c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc06c06c8f0 0x7fc06c06edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0900b8110 tx=0x7fc078009040 comp rx=0 tx=0).stop 2024-04-27T02:38:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900701e0 msgr2=0x7fc0900b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900701e0 0x7fc0900b99c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc080000c00 tx=0x7fc0800046c0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 shutdown_connections 2024-04-27T02:38:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc06c06c8f0 0x7fc06c06edb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0901468d0 0x7fc0901dfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc0900b6a90 0x7fc0901df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 --2- 172.21.15.16:0/1089583241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0900701e0 0x7fc0900b99c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 >> 172.21.15.16:0/1089583241 conn(0x7fc090068270 msgr2=0x7fc0901449c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.113+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 shutdown_connections 2024-04-27T02:38:40.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.114+0000 7fc08fe00640 1 -- 172.21.15.16:0/1089583241 wait complete. 2024-04-27T02:38:40.108 INFO:tasks.ceph:Scrubbing osd.1 2024-04-27T02:38:40.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:40.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.350+0000 7f6f13000640 1 Processor -- start 2024-04-27T02:38:40.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.351+0000 7f6f13000640 1 -- start start 2024-04-27T02:38:40.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.352+0000 7f6f13000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 0x7f6f0c0bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.352+0000 7f6f13000640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f0c09d250 0x7f6f0c14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.352+0000 7f6f13000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f0c09c8e0 con 0x7f6f0c09be20 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.352+0000 7f6f13000640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0c14b900 con 0x7f6f0c09d250 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.352+0000 7f6f13000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c09c200 con 0x7f6f0c142920 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.352+0000 7f6f11c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6f0c09be20 0x7f6f0c142210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47376/0 (socket says 172.21.15.16:47376) 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.352+0000 7f6f11c00640 1 -- 172.21.15.16:0/789489006 learned_addr learned my addr 172.21.15.16:0/789489006 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f11200640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 0x7f6f0c0bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723989926 0 0) 0x7f6efc001490 con 0x7f6f0c09be20 2024-04-27T02:38:40.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ef0003520 con 0x7f6f0c09be20 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f12600640 1 --2- 172.21.15.16:0/789489006 >> v2:172.21.15.32:3300/0 conn(0x7f6f0c09d250 0x7f6f0c14bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1800795969 0 0) 0x7f6ef0003520 con 0x7f6f0c09be20 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 msgr2=0x7f6f0c0bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 0x7f6f0c0bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 >> v2:172.21.15.32:3300/0 conn(0x7f6f0c09d250 msgr2=0x7f6f0c14bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 --2- 172.21.15.16:0/789489006 >> v2:172.21.15.32:3300/0 conn(0x7f6f0c09d250 0x7f6f0c14bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c0bba80 con 0x7f6f0c09be20 2024-04-27T02:38:40.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f6efc001bc0 con 0x7f6f0c09be20 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.353+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 >> v1:172.21.15.16:6789/0 conn(0x7f6f0c09be20 legacy=0x7f6f0c142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f0be00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00039b0 0x7f6ef0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f0be00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 0x7f6ef0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f0be00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef0004d40 0x7f6ef00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c14b900 con 0x7f6ef00039b0 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c09c200 con 0x7f6ef0004d40 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef000b9f0 con 0x7f6f0c142920 2024-04-27T02:38:40.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11c00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00039b0 0x7f6ef0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11200640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 0x7f6ef0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11c00640 1 -- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 msgr2=0x7f6ef0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f12600640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef0004d40 0x7f6ef00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11c00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 0x7f6ef0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11c00640 1 -- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef0004d40 msgr2=0x7f6ef00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11c00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef0004d40 0x7f6ef00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11c00640 1 -- 172.21.15.16:0/789489006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef0003520 con 0x7f6ef00039b0 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f11200640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6f0c142920 0x7f6ef0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.354+0000 7f6f12600640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef0004d40 0x7f6ef00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.355+0000 7f6f11c00640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00039b0 0x7f6ef0003dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00a980 tx=0x7f6ef0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fddc8b293d0b39e server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:40.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00a5a0 con 0x7f6ef00039b0 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc02f070 con 0x7f6ef00039b0 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f0be00640 1 -- 172.21.15.16:0/789489006 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc02be10 con 0x7f6ef00039b0 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f13000640 1 -- 172.21.15.16:0/789489006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00039b0 msgr2=0x7f6ef0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f13000640 1 --2- 172.21.15.16:0/789489006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00039b0 0x7f6ef0003dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00a980 tx=0x7f6ef0005830 comp rx=0 tx=0).stop 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f12600640 1 -- 172.21.15.16:0/789489006 reap_dead start 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f13000640 1 -- 172.21.15.16:0/789489006 shutdown_connections 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.356+0000 7f6f13000640 1 -- 172.21.15.16:0/789489006 >> 172.21.15.16:0/789489006 conn(0x7f6f0c09fa50 msgr2=0x7f6f0c09fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.357+0000 7f6f13000640 1 -- 172.21.15.16:0/789489006 shutdown_connections 2024-04-27T02:38:40.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.357+0000 7f6f13000640 1 -- 172.21.15.16:0/789489006 wait complete. 2024-04-27T02:38:40.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.358+0000 7f6f13000640 1 Processor -- start 2024-04-27T02:38:40.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.358+0000 7f6f13000640 1 -- start start 2024-04-27T02:38:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.359+0000 7f6f13000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef00039b0 0x7f6f0c13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.359+0000 7f6f13000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f0c1d1b90 0x7f6f0c13f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.359+0000 7f6f13000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f0c1e1580 0x7f6f0c1e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.359+0000 7f6f13000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c14c450 con 0x7f6f0c1e1580 2024-04-27T02:38:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.359+0000 7f6f13000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c14c2d0 con 0x7f6f0c1d1b90 2024-04-27T02:38:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.359+0000 7f6f13000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c14c5d0 con 0x7f6ef00039b0 2024-04-27T02:38:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f0c1e1580 0x7f6f0c1e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f0c1e1580 0x7f6f0c1e1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38584/0 (socket says 172.21.15.16:38584) 2024-04-27T02:38:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 -- 172.21.15.16:0/2656127774 learned_addr learned my addr 172.21.15.16:0/2656127774 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f11c00640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef00039b0 0x7f6f0c13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f11200640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f0c1d1b90 0x7f6f0c13f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 -- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef00039b0 msgr2=0x7f6f0c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef00039b0 0x7f6f0c13ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 -- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f0c1d1b90 msgr2=0x7f6f0c13f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f0c1d1b90 0x7f6f0c13f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 -- 172.21.15.16:0/2656127774 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c09f1a0 con 0x7f6f0c1e1580 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.360+0000 7f6f12600640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f0c1e1580 0x7f6f0c1e1a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0bdbb0 tx=0x7f6f04010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.361+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400f040 con 0x7f6f0c1e1580 2024-04-27T02:38:40.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.361+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0400e870 con 0x7f6f0c1e1580 2024-04-27T02:38:40.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.361+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0c1d2b60 con 0x7f6f0c1e1580 2024-04-27T02:38:40.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.361+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400ec40 con 0x7f6f0c1e1580 2024-04-27T02:38:40.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.361+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f0c13f810 con 0x7f6f0c1e1580 2024-04-27T02:38:40.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.362+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f0c076600 con 0x7f6f0c1e1580 2024-04-27T02:38:40.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.363+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f040253f0 con 0x7f6f0c1e1580 2024-04-27T02:38:40.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.364+0000 7f6f09600640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6eec06c920 0x7f6eec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.364+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f6f0408bda0 con 0x7f6f0c1e1580 2024-04-27T02:38:40.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.364+0000 7f6f09600640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7f6eec074b20 0x7f6eec076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.364+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 --> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6eec077610 con 0x7f6eec074b20 2024-04-27T02:38:40.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.364+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6f0408e3c0 con 0x7f6f0c1e1580 2024-04-27T02:38:40.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.364+0000 7f6f11c00640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6eec06c920 0x7f6eec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.365+0000 7f6f11200640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7f6eec074b20 0x7f6eec076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.365+0000 7f6f11200640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7f6eec074b20 0x7f6eec076f40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:40.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.366+0000 7f6f11c00640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6eec06c920 0x7f6eec06ede0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6efc033000 tx=0x7f6efc007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:40.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.366+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== osd.1 v2:172.21.15.16:6800/1499959106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6eec077610 con 0x7f6eec074b20 2024-04-27T02:38:40.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.381+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 --> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f0c1d1810 con 0x7f6eec074b20 2024-04-27T02:38:40.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.381+0000 7f6f09600640 1 -- 172.21.15.16:0/2656127774 <== osd.1 v2:172.21.15.16:6800/1499959106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6f0c1d1810 con 0x7f6eec074b20 2024-04-27T02:38:40.355 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:40.355 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:40.355 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:40.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.381+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7f6eec074b20 msgr2=0x7f6eec076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.381+0000 7f6f13000640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:6800/1499959106,v1:172.21.15.16:6801/1499959106] conn(0x7f6eec074b20 0x7f6eec076f40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6eec06c920 msgr2=0x7f6eec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6eec06c920 0x7f6eec06ede0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6efc033000 tx=0x7f6efc007000 comp rx=0 tx=0).stop 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f0c1e1580 msgr2=0x7f6f0c1e1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 --2- 172.21.15.16:0/2656127774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f0c1e1580 0x7f6f0c1e1a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0bdbb0 tx=0x7f6f04010c20 comp rx=0 tx=0).stop 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f12600640 1 -- 172.21.15.16:0/2656127774 reap_dead start 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 shutdown_connections 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 >> 172.21.15.16:0/2656127774 conn(0x7f6f0c09fa50 msgr2=0x7f6f0c0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 shutdown_connections 2024-04-27T02:38:40.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.382+0000 7f6f13000640 1 -- 172.21.15.16:0/2656127774 wait complete. 2024-04-27T02:38:40.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-27T02:38:40.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.618+0000 7fef29c00640 1 Processor -- start 2024-04-27T02:38:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.619+0000 7fef29c00640 1 -- start start 2024-04-27T02:38:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.620+0000 7fef29c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef240b6a90 0x7fef24072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.620+0000 7fef29c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef240701e0 0x7fef24073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.620+0000 7fef29c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef241461c0 0x7fef24146650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.620+0000 7fef29c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fef240b3cf0 con 0x7fef240701e0 2024-04-27T02:38:40.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.620+0000 7fef29c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fef240714b0 con 0x7fef241461c0 2024-04-27T02:38:40.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.620+0000 7fef29c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fef24070770 con 0x7fef240b6a90 2024-04-27T02:38:40.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef240701e0 0x7fef24073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef240701e0 0x7fef24073430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38594/0 (socket says 172.21.15.16:38594) 2024-04-27T02:38:40.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 -- 172.21.15.16:0/1959156503 learned_addr learned my addr 172.21.15.16:0/1959156503 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:40.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef23e00640 1 --2- 172.21.15.16:0/1959156503 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef240b6a90 0x7fef24072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef29200640 1 --2- 172.21.15.16:0/1959156503 >> v2:172.21.15.32:3300/0 conn(0x7fef241461c0 0x7fef24146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 -- 172.21.15.16:0/1959156503 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef240b6a90 msgr2=0x7fef24072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 --2- 172.21.15.16:0/1959156503 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef240b6a90 0x7fef24072ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 -- 172.21.15.16:0/1959156503 >> v2:172.21.15.32:3300/0 conn(0x7fef241461c0 msgr2=0x7fef24146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 --2- 172.21.15.16:0/1959156503 >> v2:172.21.15.32:3300/0 conn(0x7fef241461c0 0x7fef24146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.621+0000 7fef1b400640 1 -- 172.21.15.16:0/1959156503 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef240b6e70 con 0x7fef240701e0 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.622+0000 7fef1b400640 1 --2- 172.21.15.16:0/1959156503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240701e0 0x7fef24073430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef24070190 tx=0x7fef0c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81131be116cc81fb server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.623+0000 7fef23400640 1 -- 172.21.15.16:0/1959156503 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c037070 con 0x7fef240701e0 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.623+0000 7fef23400640 1 -- 172.21.15.16:0/1959156503 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c02ae10 con 0x7fef240701e0 2024-04-27T02:38:40.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.623+0000 7fef23400640 1 -- 172.21.15.16:0/1959156503 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c032660 con 0x7fef240701e0 2024-04-27T02:38:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.623+0000 7fef29c00640 1 -- 172.21.15.16:0/1959156503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240701e0 msgr2=0x7fef24073430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.623+0000 7fef29c00640 1 --2- 172.21.15.16:0/1959156503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240701e0 0x7fef24073430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef24070190 tx=0x7fef0c02a100 comp rx=0 tx=0).stop 2024-04-27T02:38:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.624+0000 7fef29c00640 1 -- 172.21.15.16:0/1959156503 shutdown_connections 2024-04-27T02:38:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.624+0000 7fef29c00640 1 --2- 172.21.15.16:0/1959156503 >> v2:172.21.15.32:3300/0 conn(0x7fef241461c0 0x7fef24146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.624+0000 7fef29c00640 1 --2- 172.21.15.16:0/1959156503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240701e0 0x7fef24073430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.624+0000 7fef29c00640 1 --2- 172.21.15.16:0/1959156503 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef240b6a90 0x7fef24072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.624+0000 7fef29c00640 1 -- 172.21.15.16:0/1959156503 >> 172.21.15.16:0/1959156503 conn(0x7fef24068270 msgr2=0x7fef24068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.624+0000 7fef29c00640 1 -- 172.21.15.16:0/1959156503 shutdown_connections 2024-04-27T02:38:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.624+0000 7fef29c00640 1 -- 172.21.15.16:0/1959156503 wait complete. 2024-04-27T02:38:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.625+0000 7fef29c00640 1 Processor -- start 2024-04-27T02:38:40.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.625+0000 7fef29c00640 1 -- start start 2024-04-27T02:38:40.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef29c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240701e0 0x7fef241dded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef29c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240b6a90 0x7fef24142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef29c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef241461c0 0x7fef24137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef29c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef24073ca0 con 0x7fef240b6a90 2024-04-27T02:38:40.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef29c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fef24146b90 con 0x7fef240701e0 2024-04-27T02:38:40.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef29c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fef24073e20 con 0x7fef241461c0 2024-04-27T02:38:40.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef1b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240b6a90 0x7fef24142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef1b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240b6a90 0x7fef24142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38604/0 (socket says 172.21.15.16:38604) 2024-04-27T02:38:40.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.626+0000 7fef1b400640 1 -- 172.21.15.16:0/742448982 learned_addr learned my addr 172.21.15.16:0/742448982 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef23e00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240701e0 0x7fef241dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef29200640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef241461c0 0x7fef24137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef1b400640 1 -- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef241461c0 msgr2=0x7fef24137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef1b400640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef241461c0 0x7fef24137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef1b400640 1 -- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240701e0 msgr2=0x7fef241dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef1b400640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240701e0 0x7fef241dded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef1b400640 1 -- 172.21.15.16:0/742448982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2413ba80 con 0x7fef240b6a90 2024-04-27T02:38:40.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef23e00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240701e0 0x7fef241dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T02:38:40.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.627+0000 7fef1b400640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240b6a90 0x7fef24142b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000c00 tx=0x7fef0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:40.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.628+0000 7fef20c00640 1 -- 172.21.15.16:0/742448982 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c041020 con 0x7fef240b6a90 2024-04-27T02:38:40.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.628+0000 7fef20c00640 1 -- 172.21.15.16:0/742448982 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c03c670 con 0x7fef240b6a90 2024-04-27T02:38:40.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.628+0000 7fef20c00640 1 -- 172.21.15.16:0/742448982 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c037040 con 0x7fef240b6a90 2024-04-27T02:38:40.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.628+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef241de540 con 0x7fef240b6a90 2024-04-27T02:38:40.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.628+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2413bcf0 con 0x7fef240b6a90 2024-04-27T02:38:40.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.629+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef24076600 con 0x7fef240b6a90 2024-04-27T02:38:40.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.630+0000 7fef20c00640 1 -- 172.21.15.16:0/742448982 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef0c044020 con 0x7fef240b6a90 2024-04-27T02:38:40.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.631+0000 7fef20c00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fef0006c8f0 0x7fef0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:40.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.631+0000 7fef20c00640 1 -- 172.21.15.16:0/742448982 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7fef0c0ac2c0 con 0x7fef240b6a90 2024-04-27T02:38:40.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.631+0000 7fef23e00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fef0006c8f0 0x7fef0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:40.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.633+0000 7fef23e00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fef0006c8f0 0x7fef0006edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fef14009b20 tx=0x7fef140039d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:40.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.635+0000 7fef20c00640 1 -- 172.21.15.16:0/742448982 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fef0c04b030 con 0x7fef240b6a90 2024-04-27T02:38:40.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.842+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fef24144d50 con 0x7fef0006c8f0 2024-04-27T02:38:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.843+0000 7fef20c00640 1 -- 172.21.15.16:0/742448982 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef24144d50 con 0x7fef0006c8f0 2024-04-27T02:38:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-04-27T02:38:40.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fef0006c8f0 msgr2=0x7fef0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fef0006c8f0 0x7fef0006edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fef14009b20 tx=0x7fef140039d0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240b6a90 msgr2=0x7fef24142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:40.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240b6a90 0x7fef24142b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000c00 tx=0x7fef0c0046c0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 shutdown_connections 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fef0006c8f0 0x7fef0006edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fef241461c0 0x7fef24137a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef240b6a90 0x7fef24142b40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 --2- 172.21.15.16:0/742448982 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240701e0 0x7fef241dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 >> 172.21.15.16:0/742448982 conn(0x7fef24068270 msgr2=0x7fef24145270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 shutdown_connections 2024-04-27T02:38:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:40.846+0000 7fef29c00640 1 -- 172.21.15.16:0/742448982 wait complete. 2024-04-27T02:38:40.838 INFO:tasks.ceph:Scrubbing osd.2 2024-04-27T02:38:40.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:41.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.081+0000 7f58a3200640 1 Processor -- start 2024-04-27T02:38:41.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.081+0000 7f58a3200640 1 -- start start 2024-04-27T02:38:41.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a3200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f58a40b68d0 0x7f58a40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a3200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58a4073390 0x7f58a4150950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a3200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a4071470 con 0x7f58a41495e0 2024-04-27T02:38:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a3200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f58a40b3640 con 0x7f58a4073390 2024-04-27T02:38:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a3200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f58a40b6cb0 con 0x7f58a40b68d0 2024-04-27T02:38:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58a4073390 0x7f58a4150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58a4073390 0x7f58a4150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38612/0 (socket says 172.21.15.16:38612) 2024-04-27T02:38:41.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.083+0000 7f58a2800640 1 -- 172.21.15.16:0/370586634 learned_addr learned my addr 172.21.15.16:0/370586634 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:41.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.084+0000 7f58a2800640 1 -- 172.21.15.16:0/370586634 >> v2:172.21.15.32:3300/0 conn(0x7f58a40b68d0 msgr2=0x7f58a40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:41.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.084+0000 7f58a2800640 1 --2- 172.21.15.16:0/370586634 >> v2:172.21.15.32:3300/0 conn(0x7f58a40b68d0 0x7f58a40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.084+0000 7f58a2800640 1 -- 172.21.15.16:0/370586634 >> v1:172.21.15.32:6789/0 conn(0x7f58a41495e0 legacy=0x7f58a4072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.084+0000 7f58a2800640 1 -- 172.21.15.16:0/370586634 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a4149a20 con 0x7f58a4073390 2024-04-27T02:38:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.085+0000 7f58a2800640 1 --2- 172.21.15.16:0/370586634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a4073390 0x7f58a4150950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f58a406e8a0 tx=0x7f589c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59737c2bf42635c server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.085+0000 7f58a1400640 1 -- 172.21.15.16:0/370586634 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c036070 con 0x7f58a4073390 2024-04-27T02:38:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.085+0000 7f58a1400640 1 -- 172.21.15.16:0/370586634 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c031600 con 0x7f58a4073390 2024-04-27T02:38:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.085+0000 7f58a1400640 1 -- 172.21.15.16:0/370586634 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0319d0 con 0x7f58a4073390 2024-04-27T02:38:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 -- 172.21.15.16:0/370586634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a4073390 msgr2=0x7f58a4150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 --2- 172.21.15.16:0/370586634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a4073390 0x7f58a4150950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f58a406e8a0 tx=0x7f589c02a5d0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 -- 172.21.15.16:0/370586634 shutdown_connections 2024-04-27T02:38:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 --2- 172.21.15.16:0/370586634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a4073390 0x7f58a4150950 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 --2- 172.21.15.16:0/370586634 >> v2:172.21.15.32:3300/0 conn(0x7f58a40b68d0 0x7f58a40b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 -- 172.21.15.16:0/370586634 >> 172.21.15.16:0/370586634 conn(0x7f58a4068270 msgr2=0x7f58a4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 -- 172.21.15.16:0/370586634 shutdown_connections 2024-04-27T02:38:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.086+0000 7f58a3200640 1 -- 172.21.15.16:0/370586634 wait complete. 2024-04-27T02:38:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.087+0000 7f58a3200640 1 Processor -- start 2024-04-27T02:38:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.088+0000 7f58a3200640 1 -- start start 2024-04-27T02:38:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.088+0000 7f58a3200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a4073390 0x7f58a40b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.088+0000 7f58a3200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a40b68d0 0x7f58a4141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.088+0000 7f58a3200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f58a41495e0 0x7f58a41424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.088+0000 7f58a3200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f58a40b0ab0 con 0x7f58a40b68d0 2024-04-27T02:38:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f58a3200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f58a40b6050 con 0x7f58a4073390 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f58a3200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f58a40710f0 con 0x7f58a41495e0 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a40b68d0 0x7f58a4141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a40b68d0 0x7f58a4141f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38626/0 (socket says 172.21.15.16:38626) 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 -- 172.21.15.16:0/968753342 learned_addr learned my addr 172.21.15.16:0/968753342 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f58a1e00640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a4073390 0x7f58a40b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f58a2800640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f58a41495e0 0x7f58a41424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 -- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f58a41495e0 msgr2=0x7f58a41424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f58a41495e0 0x7f58a41424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 -- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a4073390 msgr2=0x7f58a40b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a4073390 0x7f58a40b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f589be00640 1 -- 172.21.15.16:0/968753342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a4143520 con 0x7f58a40b68d0 2024-04-27T02:38:41.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.089+0000 7f58a1e00640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58a4073390 0x7f58a40b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T02:38:41.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.090+0000 7f589be00640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a40b68d0 0x7f58a4141f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f588c00b3e0 tx=0x7f588c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.090+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c015020 con 0x7f58a40b68d0 2024-04-27T02:38:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.090+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c011850 con 0x7f58a40b68d0 2024-04-27T02:38:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.090+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c011c40 con 0x7f58a40b68d0 2024-04-27T02:38:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.090+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a40b2d30 con 0x7f58a40b68d0 2024-04-27T02:38:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.090+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a40b2330 con 0x7f58a40b68d0 2024-04-27T02:38:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.091+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58a4076600 con 0x7f58a40b68d0 2024-04-27T02:38:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.092+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f588c018020 con 0x7f58a40b68d0 2024-04-27T02:38:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.093+0000 7f589a000640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f588006c8f0 0x7f588006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.093+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f588c08bb40 con 0x7f58a40b68d0 2024-04-27T02:38:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.094+0000 7f589a000640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f5880074b50 0x7f5880076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.094+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 --> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5880077640 con 0x7f5880074b50 2024-04-27T02:38:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.094+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f588c0902a0 con 0x7f58a40b68d0 2024-04-27T02:38:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.094+0000 7f58a2800640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f5880074b50 0x7f5880076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.094+0000 7f58a1e00640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f588006c8f0 0x7f588006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.095+0000 7f58a2800640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f5880074b50 0x7f5880076f70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.095+0000 7f58a1e00640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f588006c8f0 0x7f588006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5894009930 tx=0x7f5894008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.096+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== osd.2 v2:172.21.15.16:6816/1958514319 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5880077640 con 0x7f5880074b50 2024-04-27T02:38:41.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.110+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 --> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f58a4072e00 con 0x7f5880074b50 2024-04-27T02:38:41.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.111+0000 7f589a000640 1 -- 172.21.15.16:0/968753342 <== osd.2 v2:172.21.15.16:6816/1958514319 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f58a4072e00 con 0x7f5880074b50 2024-04-27T02:38:41.085 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:41.085 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:41.085 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:41.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.111+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f5880074b50 msgr2=0x7f5880076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.111+0000 7f58a3200640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:6816/1958514319,v1:172.21.15.16:6817/1958514319] conn(0x7f5880074b50 0x7f5880076f70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.111+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f588006c8f0 msgr2=0x7f588006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.111+0000 7f58a3200640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f588006c8f0 0x7f588006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5894009930 tx=0x7f5894008040 comp rx=0 tx=0).stop 2024-04-27T02:38:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.111+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a40b68d0 msgr2=0x7f58a4141f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.111+0000 7f58a3200640 1 --2- 172.21.15.16:0/968753342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58a40b68d0 0x7f58a4141f70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f588c00b3e0 tx=0x7f588c00b8a0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.112+0000 7f58a2800640 1 -- 172.21.15.16:0/968753342 reap_dead start 2024-04-27T02:38:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.112+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 shutdown_connections 2024-04-27T02:38:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.112+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 >> 172.21.15.16:0/968753342 conn(0x7f58a4068270 msgr2=0x7f58a4071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.112+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 shutdown_connections 2024-04-27T02:38:41.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.112+0000 7f58a3200640 1 -- 172.21.15.16:0/968753342 wait complete. 2024-04-27T02:38:41.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-27T02:38:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.342+0000 7f3b4b200640 1 Processor -- start 2024-04-27T02:38:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.342+0000 7f3b4b200640 1 -- start start 2024-04-27T02:38:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.343+0000 7f3b4b200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 0x7f3b44072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.344+0000 7f3b4b200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b440b6e70 con 0x7f3b441468d0 2024-04-27T02:38:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.344+0000 7f3b4b200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b440b39a0 con 0x7f3b440701e0 2024-04-27T02:38:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.344+0000 7f3b4b200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f3b440b3cf0 con 0x7f3b440b6a90 2024-04-27T02:38:41.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.344+0000 7f3b4a800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3b441468d0 0x7f3b44150a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47378/0 (socket says 172.21.15.16:47378) 2024-04-27T02:38:41.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.344+0000 7f3b4a800640 1 -- 172.21.15.16:0/2679988884 learned_addr learned my addr 172.21.15.16:0/2679988884 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.344+0000 7f3b49e00640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 0x7f3b44072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.344+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514379883 0 0) 0x7f3b440b6e70 con 0x7f3b441468d0 2024-04-27T02:38:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b2c003520 con 0x7f3b441468d0 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633922480 0 0) 0x7f3b440b39a0 con 0x7f3b440701e0 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b440b6e70 con 0x7f3b440701e0 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 741170033 0 0) 0x7f3b2c003520 con 0x7f3b441468d0 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 msgr2=0x7f3b44072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 0x7f3b44072ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 >> v1:172.21.15.32:6789/0 conn(0x7f3b440701e0 legacy=0x7f3b441461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b44073ca0 con 0x7f3b441468d0 2024-04-27T02:38:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f3b400019f0 con 0x7f3b441468d0 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 >> v1:172.21.15.16:6789/0 conn(0x7f3b441468d0 legacy=0x7f3b44150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 0x7f3b2c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b2c004d40 0x7f3b2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440b3cf0 con 0x7f3b2c0040d0 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c00bbd0 con 0x7f3b2c004d40 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2c00bdd0 con 0x7f3b440b6a90 2024-04-27T02:38:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.345+0000 7f3b49400640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.346+0000 7f3b49e00640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 0x7f3b2c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.346+0000 7f3b4a800640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b2c004d40 0x7f3b2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.346+0000 7f3b49400640 1 -- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 msgr2=0x7f3b2c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.346+0000 7f3b49400640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b440b6a90 0x7f3b2c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.346+0000 7f3b49400640 1 -- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b2c004d40 msgr2=0x7f3b2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.346+0000 7f3b49400640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b2c004d40 0x7f3b2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.346+0000 7f3b49400640 1 -- 172.21.15.16:0/2679988884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c003520 con 0x7f3b2c0040d0 2024-04-27T02:38:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.347+0000 7f3b49400640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b2c004800 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b340018d0 tx=0x7f3b2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48ec2e91f054eee server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.347+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340014f0 con 0x7f3b2c0040d0 2024-04-27T02:38:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.347+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b340052d0 con 0x7f3b2c0040d0 2024-04-27T02:38:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.347+0000 7f3b48a00640 1 -- 172.21.15.16:0/2679988884 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3402aca0 con 0x7f3b2c0040d0 2024-04-27T02:38:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.348+0000 7f3b4b200640 1 -- 172.21.15.16:0/2679988884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 msgr2=0x7f3b2c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.348+0000 7f3b4b200640 1 --2- 172.21.15.16:0/2679988884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b2c004800 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b340018d0 tx=0x7f3b2c005830 comp rx=0 tx=0).stop 2024-04-27T02:38:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.348+0000 7f3b4a800640 1 -- 172.21.15.16:0/2679988884 reap_dead start 2024-04-27T02:38:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.348+0000 7f3b4b200640 1 -- 172.21.15.16:0/2679988884 shutdown_connections 2024-04-27T02:38:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.348+0000 7f3b4b200640 1 -- 172.21.15.16:0/2679988884 >> 172.21.15.16:0/2679988884 conn(0x7f3b44068270 msgr2=0x7f3b44068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.348+0000 7f3b4b200640 1 -- 172.21.15.16:0/2679988884 shutdown_connections 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.348+0000 7f3b4b200640 1 -- 172.21.15.16:0/2679988884 wait complete. 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.350+0000 7f3b4b200640 1 Processor -- start 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.350+0000 7f3b4b200640 1 -- start start 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b4b200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b440b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b4b200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b44142a80 0x7f3b441ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b4b200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b441de1f0 0x7f3b4413be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b4b200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440732c0 con 0x7f3b2c0040d0 2024-04-27T02:38:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b4b200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44073140 con 0x7f3b44142a80 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b4b200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f3b44073440 con 0x7f3b441de1f0 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b440b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b440b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38634/0 (socket says 172.21.15.16:38634) 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 -- 172.21.15.16:0/325357187 learned_addr learned my addr 172.21.15.16:0/325357187 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49400640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b44142a80 0x7f3b441ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b4a800640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b441de1f0 0x7f3b4413be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 -- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b441de1f0 msgr2=0x7f3b4413be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b441de1f0 0x7f3b4413be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 -- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b44142a80 msgr2=0x7f3b441ddcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b44142a80 0x7f3b441ddcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.351+0000 7f3b49e00640 1 -- 172.21.15.16:0/325357187 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b44143970 con 0x7f3b2c0040d0 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.352+0000 7f3b49e00640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b440b2060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b38011660 tx=0x7f3b38011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.352+0000 7f3b3e000640 1 -- 172.21.15.16:0/325357187 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800f960 con 0x7f3b2c0040d0 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.352+0000 7f3b3e000640 1 -- 172.21.15.16:0/325357187 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3800fb00 con 0x7f3b2c0040d0 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.352+0000 7f3b3e000640 1 -- 172.21.15.16:0/325357187 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38015460 con 0x7f3b2c0040d0 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.352+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b44142fd0 con 0x7f3b2c0040d0 2024-04-27T02:38:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.352+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b44141e60 con 0x7f3b2c0040d0 2024-04-27T02:38:41.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.353+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b44143b70 con 0x7f3b2c0040d0 2024-04-27T02:38:41.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.354+0000 7f3b3e000640 1 -- 172.21.15.16:0/325357187 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b38015600 con 0x7f3b2c0040d0 2024-04-27T02:38:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.355+0000 7f3b3e000640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3b2806c920 0x7f3b2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.355+0000 7f3b3e000640 1 -- 172.21.15.16:0/325357187 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f3b3808c3d0 con 0x7f3b2c0040d0 2024-04-27T02:38:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.356+0000 7f3b49400640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3b2806c920 0x7f3b2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.357+0000 7f3b49400640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3b2806c920 0x7f3b2806ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3b34032000 tx=0x7f3b34009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.360+0000 7f3b3e000640 1 -- 172.21.15.16:0/325357187 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3b44143b70 con 0x7f3b2c0040d0 2024-04-27T02:38:41.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.566+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f3b44076600 con 0x7f3b2806c920 2024-04-27T02:38:41.541 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-04-27T02:38:41.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.567+0000 7f3b3e000640 1 -- 172.21.15.16:0/325357187 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3b44076600 con 0x7f3b2806c920 2024-04-27T02:38:41.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3b2806c920 msgr2=0x7f3b2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3b2806c920 0x7f3b2806ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3b34032000 tx=0x7f3b34009030 comp rx=0 tx=0).stop 2024-04-27T02:38:41.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 msgr2=0x7f3b440b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b440b2060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b38011660 tx=0x7f3b38011b20 comp rx=0 tx=0).stop 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 shutdown_connections 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3b2806c920 0x7f3b2806ede0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3b44142a80 0x7f3b441ddcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3b441de1f0 0x7f3b4413be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 --2- 172.21.15.16:0/325357187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0040d0 0x7f3b440b2060 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 >> 172.21.15.16:0/325357187 conn(0x7f3b44068270 msgr2=0x7f3b440b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.570+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 shutdown_connections 2024-04-27T02:38:41.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.571+0000 7f3b4b200640 1 -- 172.21.15.16:0/325357187 wait complete. 2024-04-27T02:38:41.564 INFO:tasks.ceph:Scrubbing osd.3 2024-04-27T02:38:41.565 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:41.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.808+0000 7f7b4d800640 1 Processor -- start 2024-04-27T02:38:41.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.808+0000 7f7b4d800640 1 -- start start 2024-04-27T02:38:41.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4d800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b48142920 0x7f7b480bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4d800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b4809d250 0x7f7b4814bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4d800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b4809c8e0 con 0x7f7b4809be20 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4d800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7b4814b900 con 0x7f7b4809d250 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4d800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4809c200 con 0x7f7b48142920 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4ce00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b4809d250 0x7f7b4814bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4ce00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b4809d250 0x7f7b4814bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38648/0 (socket says 172.21.15.16:38648) 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.810+0000 7f7b4ce00640 1 -- 172.21.15.16:0/128877291 learned_addr learned my addr 172.21.15.16:0/128877291 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.811+0000 7f7b47400640 1 --2- 172.21.15.16:0/128877291 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b48142920 0x7f7b480bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.811+0000 7f7b4ce00640 1 -- 172.21.15.16:0/128877291 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b48142920 msgr2=0x7f7b480bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.811+0000 7f7b4ce00640 1 --2- 172.21.15.16:0/128877291 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b48142920 0x7f7b480bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.811+0000 7f7b4ce00640 1 -- 172.21.15.16:0/128877291 >> v1:172.21.15.32:6789/0 conn(0x7f7b4809be20 legacy=0x7f7b48142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.811+0000 7f7b4ce00640 1 -- 172.21.15.16:0/128877291 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b480bba80 con 0x7f7b4809d250 2024-04-27T02:38:41.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.812+0000 7f7b4ce00640 1 --2- 172.21.15.16:0/128877291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4814bd90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009870 tx=0x7f7b4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ebb7943f177b5f server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.812+0000 7f7b46a00640 1 -- 172.21.15.16:0/128877291 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b40037070 con 0x7f7b4809d250 2024-04-27T02:38:41.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.812+0000 7f7b46a00640 1 -- 172.21.15.16:0/128877291 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b40032440 con 0x7f7b4809d250 2024-04-27T02:38:41.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.812+0000 7f7b46a00640 1 -- 172.21.15.16:0/128877291 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b40032810 con 0x7f7b4809d250 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 -- 172.21.15.16:0/128877291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 msgr2=0x7f7b4814bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 --2- 172.21.15.16:0/128877291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4814bd90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009870 tx=0x7f7b4002a1e0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 -- 172.21.15.16:0/128877291 shutdown_connections 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 --2- 172.21.15.16:0/128877291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4814bd90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 --2- 172.21.15.16:0/128877291 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b48142920 0x7f7b480bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 -- 172.21.15.16:0/128877291 >> 172.21.15.16:0/128877291 conn(0x7f7b4809fa50 msgr2=0x7f7b4809fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 -- 172.21.15.16:0/128877291 shutdown_connections 2024-04-27T02:38:41.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.813+0000 7f7b4d800640 1 -- 172.21.15.16:0/128877291 wait complete. 2024-04-27T02:38:41.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.815+0000 7f7b4d800640 1 Processor -- start 2024-04-27T02:38:41.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.815+0000 7f7b4d800640 1 -- start start 2024-04-27T02:38:41.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b4d800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b4809be20 0x7f7b4813ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b4d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4813f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b4d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b48142920 0x7f7b481e1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b4d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4814c450 con 0x7f7b4809d250 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b4d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4814c2d0 con 0x7f7b48142920 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b4d800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4814c5d0 con 0x7f7b4809be20 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b47400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4813f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b47400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4813f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38664/0 (socket says 172.21.15.16:38664) 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b47400640 1 -- 172.21.15.16:0/358219328 learned_addr learned my addr 172.21.15.16:0/358219328 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.816+0000 7f7b47e00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b4809be20 0x7f7b4813ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b4ce00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b48142920 0x7f7b481e1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b47400640 1 -- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b4809be20 msgr2=0x7f7b4813ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b47400640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f7b4809be20 0x7f7b4813ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b47400640 1 -- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b48142920 msgr2=0x7f7b481e1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b47400640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b48142920 0x7f7b481e1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b47400640 1 -- 172.21.15.16:0/358219328 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b48147970 con 0x7f7b4809d250 2024-04-27T02:38:41.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b47400640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4813f2d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400d800 tx=0x7f7b3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400b6c0 con 0x7f7b4809d250 2024-04-27T02:38:41.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b34019070 con 0x7f7b4809d250 2024-04-27T02:38:41.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b48148720 con 0x7f7b4809d250 2024-04-27T02:38:41.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.817+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400bac0 con 0x7f7b4809d250 2024-04-27T02:38:41.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.818+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4813f810 con 0x7f7b4809d250 2024-04-27T02:38:41.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.819+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b48144b80 con 0x7f7b4809d250 2024-04-27T02:38:41.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.820+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b3400bc60 con 0x7f7b4809d250 2024-04-27T02:38:41.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.821+0000 7f7b3fe00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b2806c8f0 0x7f7b2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.821+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f7b3408c080 con 0x7f7b4809d250 2024-04-27T02:38:41.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.821+0000 7f7b3fe00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f7b28074b50 0x7f7b28076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:41.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.821+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 --> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b28077640 con 0x7f7b28074b50 2024-04-27T02:38:41.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.821+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7b34093050 con 0x7f7b4809d250 2024-04-27T02:38:41.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.821+0000 7f7b47e00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b2806c8f0 0x7f7b2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.821+0000 7f7b4ce00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f7b28074b50 0x7f7b28076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:41.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.822+0000 7f7b4ce00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f7b28074b50 0x7f7b28076f70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.822+0000 7f7b47e00640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b2806c8f0 0x7f7b2806edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b380012e0 tx=0x7f7b38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:41.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.823+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== osd.3 v2:172.21.15.16:6824/882010783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b28077640 con 0x7f7b28074b50 2024-04-27T02:38:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.838+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 --> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7b48076600 con 0x7f7b28074b50 2024-04-27T02:38:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.838+0000 7f7b3fe00640 1 -- 172.21.15.16:0/358219328 <== osd.3 v2:172.21.15.16:6824/882010783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7b48076600 con 0x7f7b28074b50 2024-04-27T02:38:41.812 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:41.812 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:41.812 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.838+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f7b28074b50 msgr2=0x7f7b28076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.838+0000 7f7b4d800640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:6824/882010783,v1:172.21.15.16:6825/882010783] conn(0x7f7b28074b50 0x7f7b28076f70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b2806c8f0 msgr2=0x7f7b2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f7b2806c8f0 0x7f7b2806edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b380012e0 tx=0x7f7b38009040 comp rx=0 tx=0).stop 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 msgr2=0x7f7b4813f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 --2- 172.21.15.16:0/358219328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b4809d250 0x7f7b4813f2d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400d800 tx=0x7f7b3400dcc0 comp rx=0 tx=0).stop 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4ce00640 1 -- 172.21.15.16:0/358219328 reap_dead start 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 shutdown_connections 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 >> 172.21.15.16:0/358219328 conn(0x7f7b4809fa50 msgr2=0x7f7b480bde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 shutdown_connections 2024-04-27T02:38:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:41.839+0000 7f7b4d800640 1 -- 172.21.15.16:0/358219328 wait complete. 2024-04-27T02:38:41.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-27T02:38:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.072+0000 7f4e5d800640 1 Processor -- start 2024-04-27T02:38:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.072+0000 7f4e5d800640 1 -- start start 2024-04-27T02:38:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.073+0000 7f4e5d800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4e58140930 0x7f4e580b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.073+0000 7f4e5d800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e5806e710 con 0x7f4e580b37a0 2024-04-27T02:38:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.073+0000 7f4e5d800640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e580b63d0 con 0x7f4e5806e330 2024-04-27T02:38:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.073+0000 7f4e5d800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4e580b1ec0 con 0x7f4e58140930 2024-04-27T02:38:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e4fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4e580b37a0 0x7f4e58140220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47386/0 (socket says 172.21.15.16:47386) 2024-04-27T02:38:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e4fe00640 1 -- 172.21.15.16:0/2419909236 learned_addr learned my addr 172.21.15.16:0/2419909236 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:42.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e57400640 1 --2- 172.21.15.16:0/2419909236 >> v2:172.21.15.16:3300/0 conn(0x7f4e58140930 0x7f4e580b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e56000640 1 -- 172.21.15.16:0/2419909236 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442608048 0 0) 0x7f4e5806e710 con 0x7f4e580b37a0 2024-04-27T02:38:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e56000640 1 -- 172.21.15.16:0/2419909236 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e38003520 con 0x7f4e580b37a0 2024-04-27T02:38:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e57400640 1 -- 172.21.15.16:0/2419909236 >> v1:172.21.15.32:6789/0 conn(0x7f4e5806e330 legacy=0x7f4e58073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e57400640 1 -- 172.21.15.16:0/2419909236 >> v1:172.21.15.16:6789/0 conn(0x7f4e580b37a0 legacy=0x7f4e58140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.074+0000 7f4e57400640 1 -- 172.21.15.16:0/2419909236 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e580b1870 con 0x7f4e58140930 2024-04-27T02:38:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.075+0000 7f4e57400640 1 --2- 172.21.15.16:0/2419909236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e580b3be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e5002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83845afebf23d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e56000640 1 -- 172.21.15.16:0/2419909236 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50007740 con 0x7f4e58140930 2024-04-27T02:38:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e56000640 1 -- 172.21.15.16:0/2419909236 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e500078e0 con 0x7f4e58140930 2024-04-27T02:38:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e56000640 1 -- 172.21.15.16:0/2419909236 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50007c90 con 0x7f4e58140930 2024-04-27T02:38:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e5d800640 1 -- 172.21.15.16:0/2419909236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 msgr2=0x7f4e580b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e5d800640 1 --2- 172.21.15.16:0/2419909236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e580b3be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e5002a660 comp rx=0 tx=0).stop 2024-04-27T02:38:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e5d800640 1 -- 172.21.15.16:0/2419909236 shutdown_connections 2024-04-27T02:38:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e5d800640 1 --2- 172.21.15.16:0/2419909236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e580b3be0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.076+0000 7f4e5d800640 1 -- 172.21.15.16:0/2419909236 >> 172.21.15.16:0/2419909236 conn(0x7f4e580b6630 msgr2=0x7f4e580b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.077+0000 7f4e5d800640 1 -- 172.21.15.16:0/2419909236 shutdown_connections 2024-04-27T02:38:42.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.077+0000 7f4e5d800640 1 -- 172.21.15.16:0/2419909236 wait complete. 2024-04-27T02:38:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.078+0000 7f4e5d800640 1 Processor -- start 2024-04-27T02:38:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.078+0000 7f4e5d800640 1 -- start start 2024-04-27T02:38:42.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e5d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e5806e330 0x7f4e58149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e5d800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4e580b37a0 0x7f4e58071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e5d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e58147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e5d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58151f30 con 0x7f4e58140930 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e5d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58151db0 con 0x7f4e5806e330 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e5d800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f4e581520b0 con 0x7f4e580b37a0 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e57400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e58147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e57400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e58147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38684/0 (socket says 172.21.15.16:38684) 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.079+0000 7f4e57400640 1 -- 172.21.15.16:0/3567570454 learned_addr learned my addr 172.21.15.16:0/3567570454 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e56a00640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e5806e330 0x7f4e58149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e4fe00640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4e580b37a0 0x7f4e58071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e57400640 1 -- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4e580b37a0 msgr2=0x7f4e58071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e57400640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4e580b37a0 0x7f4e58071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e57400640 1 -- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e5806e330 msgr2=0x7f4e58149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e57400640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e5806e330 0x7f4e58149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e57400640 1 -- 172.21.15.16:0/3567570454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e58071090 con 0x7f4e58140930 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e57400640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e58147e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e4ea00640 1 -- 172.21.15.16:0/3567570454 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50009450 con 0x7f4e58140930 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e4ea00640 1 -- 172.21.15.16:0/3567570454 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e50004240 con 0x7f4e58140930 2024-04-27T02:38:42.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e4ea00640 1 -- 172.21.15.16:0/3567570454 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50004630 con 0x7f4e58140930 2024-04-27T02:38:42.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.080+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e58149550 con 0x7f4e58140930 2024-04-27T02:38:42.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.081+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e58149d10 con 0x7f4e58140930 2024-04-27T02:38:42.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.082+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e580693a0 con 0x7f4e58140930 2024-04-27T02:38:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.083+0000 7f4e4ea00640 1 -- 172.21.15.16:0/3567570454 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e5003b410 con 0x7f4e58140930 2024-04-27T02:38:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.084+0000 7f4e4ea00640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4e3406c940 0x7f4e3406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.084+0000 7f4e4ea00640 1 -- 172.21.15.16:0/3567570454 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f4e500ac9f0 con 0x7f4e58140930 2024-04-27T02:38:42.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.084+0000 7f4e56a00640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4e3406c940 0x7f4e3406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.085+0000 7f4e56a00640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4e3406c940 0x7f4e3406ee00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4e48007fd0 tx=0x7f4e48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.088+0000 7f4e4ea00640 1 -- 172.21.15.16:0/3567570454 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e5003f030 con 0x7f4e58140930 2024-04-27T02:38:42.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.294+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4e580708c0 con 0x7f4e3406c940 2024-04-27T02:38:42.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.295+0000 7f4e4ea00640 1 -- 172.21.15.16:0/3567570454 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4e580708c0 con 0x7f4e3406c940 2024-04-27T02:38:42.283 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-04-27T02:38:42.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4e3406c940 msgr2=0x7f4e3406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4e3406c940 0x7f4e3406ee00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4e48007fd0 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2024-04-27T02:38:42.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 msgr2=0x7f4e58147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e58147e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009d90 tx=0x7f4e50004a40 comp rx=0 tx=0).stop 2024-04-27T02:38:42.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 shutdown_connections 2024-04-27T02:38:42.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f4e3406c940 0x7f4e3406ee00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e58140930 0x7f4e58147e50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f4e580b37a0 0x7f4e58071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 --2- 172.21.15.16:0/3567570454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4e5806e330 0x7f4e58149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.298+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 >> 172.21.15.16:0/3567570454 conn(0x7f4e580b6630 msgr2=0x7f4e5813fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:42.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.299+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 shutdown_connections 2024-04-27T02:38:42.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.299+0000 7f4e5d800640 1 -- 172.21.15.16:0/3567570454 wait complete. 2024-04-27T02:38:42.291 INFO:tasks.ceph:Scrubbing osd.4 2024-04-27T02:38:42.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:42.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.533+0000 7f5576c00640 1 Processor -- start 2024-04-27T02:38:42.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.534+0000 7f5576c00640 1 -- start start 2024-04-27T02:38:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5576c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 0x7f55700bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5576c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f557009d250 0x7f5570142210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5576c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557009c8e0 con 0x7f5570142750 2024-04-27T02:38:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5576c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f557014b900 con 0x7f557009d250 2024-04-27T02:38:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5576c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f557009c200 con 0x7f557009be20 2024-04-27T02:38:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5576200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5570142750 0x7f557014bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47390/0 (socket says 172.21.15.16:47390) 2024-04-27T02:38:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5576200640 1 -- 172.21.15.16:0/2295727031 learned_addr learned my addr 172.21.15.16:0/2295727031 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:42.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5575800640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 0x7f55700bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.535+0000 7f5574e00640 1 --2- 172.21.15.16:0/2295727031 >> v2:172.21.15.32:3300/0 conn(0x7f557009d250 0x7f5570142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830742248 0 0) 0x7f5568001490 con 0x7f5570142750 2024-04-27T02:38:42.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5554003520 con 0x7f5570142750 2024-04-27T02:38:42.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3456875686 0 0) 0x7f5554003520 con 0x7f5570142750 2024-04-27T02:38:42.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 msgr2=0x7f55700bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 0x7f55700bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 >> v2:172.21.15.32:3300/0 conn(0x7f557009d250 msgr2=0x7f5570142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 --2- 172.21.15.16:0/2295727031 >> v2:172.21.15.32:3300/0 conn(0x7f557009d250 0x7f5570142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55700bba80 con 0x7f5570142750 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f5568001bc0 con 0x7f5570142750 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 >> v1:172.21.15.16:6789/0 conn(0x7f5570142750 legacy=0x7f557014bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55540039b0 0x7f5554003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5554004800 0x7f5554004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 0x7f55540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f557014b900 con 0x7f5554004800 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f557009c200 con 0x7f55540039b0 2024-04-27T02:38:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.536+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f555400b9c0 con 0x7f557009be20 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5574e00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5554004800 0x7f5554004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5576200640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 0x7f55540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5575800640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55540039b0 0x7f5554003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5574e00640 1 -- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 msgr2=0x7f55540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5574e00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f557009be20 0x7f55540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5574e00640 1 -- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55540039b0 msgr2=0x7f5554003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5574e00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55540039b0 0x7f5554003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.537+0000 7f5574e00640 1 -- 172.21.15.16:0/2295727031 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5554003520 con 0x7f5554004800 2024-04-27T02:38:42.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.538+0000 7f5574e00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5554004800 0x7f5554004c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f555c009ac0 tx=0x7f5554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d01e4cd7aa1fd5e server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c036070 con 0x7f5554004800 2024-04-27T02:38:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c031400 con 0x7f5554004800 2024-04-27T02:38:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f556fe00640 1 -- 172.21.15.16:0/2295727031 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c009690 con 0x7f5554004800 2024-04-27T02:38:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f5576c00640 1 -- 172.21.15.16:0/2295727031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5554004800 msgr2=0x7f5554004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f5576c00640 1 --2- 172.21.15.16:0/2295727031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5554004800 0x7f5554004c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f555c009ac0 tx=0x7f5554005830 comp rx=0 tx=0).stop 2024-04-27T02:38:42.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f5576200640 1 -- 172.21.15.16:0/2295727031 reap_dead start 2024-04-27T02:38:42.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f5576c00640 1 -- 172.21.15.16:0/2295727031 shutdown_connections 2024-04-27T02:38:42.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f5576c00640 1 -- 172.21.15.16:0/2295727031 >> 172.21.15.16:0/2295727031 conn(0x7f557009fa50 msgr2=0x7f557009fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:42.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f5576c00640 1 -- 172.21.15.16:0/2295727031 shutdown_connections 2024-04-27T02:38:42.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.539+0000 7f5576c00640 1 -- 172.21.15.16:0/2295727031 wait complete. 2024-04-27T02:38:42.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.541+0000 7f5576c00640 1 Processor -- start 2024-04-27T02:38:42.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.541+0000 7f5576c00640 1 -- start start 2024-04-27T02:38:42.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5554004800 0x7f55700b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5570145ab0 0x7f55701449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5570143590 0x7f55701494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f557014c620 con 0x7f5570143590 2024-04-27T02:38:42.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f557014c4a0 con 0x7f5570145ab0 2024-04-27T02:38:42.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f5570144f30 con 0x7f5554004800 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5570143590 0x7f55701494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5570143590 0x7f55701494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38696/0 (socket says 172.21.15.16:38696) 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.542+0000 7f5576200640 1 -- 172.21.15.16:0/1902153953 learned_addr learned my addr 172.21.15.16:0/1902153953 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5575800640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5554004800 0x7f55700b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5574e00640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5570145ab0 0x7f55701449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5576200640 1 -- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5554004800 msgr2=0x7f55700b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5576200640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5554004800 0x7f55700b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5576200640 1 -- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5570145ab0 msgr2=0x7f55701449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5576200640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5570145ab0 0x7f55701449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5576200640 1 -- 172.21.15.16:0/1902153953 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5570142da0 con 0x7f5570143590 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.543+0000 7f5576200640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5570143590 0x7f55701494f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5568000f80 tx=0x7f556800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.544+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568017020 con 0x7f5570143590 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.544+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556800ebb0 con 0x7f5570143590 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.544+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557014b6e0 con 0x7f5570143590 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.544+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568013420 con 0x7f5570143590 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.544+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557014b1f0 con 0x7f5570143590 2024-04-27T02:38:42.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.545+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5570076600 con 0x7f5570143590 2024-04-27T02:38:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.546+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f556801a020 con 0x7f5570143590 2024-04-27T02:38:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.547+0000 7f556d600640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f555006c8f0 0x7f555006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.547+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f556808bd40 con 0x7f5570143590 2024-04-27T02:38:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.547+0000 7f556d600640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7f5550074af0 0x7f5550076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.547+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 --> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55500775e0 con 0x7f5550074af0 2024-04-27T02:38:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.547+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f556808e440 con 0x7f5570143590 2024-04-27T02:38:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.547+0000 7f5575800640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f555006c8f0 0x7f555006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.548+0000 7f5574e00640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7f5550074af0 0x7f5550076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.549+0000 7f5575800640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f555006c8f0 0x7f555006edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5560009930 tx=0x7f5560008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.549+0000 7f5574e00640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7f5550074af0 0x7f5550076f10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.552+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== osd.4 v2:172.21.15.32:6824/1044755861 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55500775e0 con 0x7f5550074af0 2024-04-27T02:38:42.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.567+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 --> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5570141ca0 con 0x7f5550074af0 2024-04-27T02:38:42.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.568+0000 7f556d600640 1 -- 172.21.15.16:0/1902153953 <== osd.4 v2:172.21.15.32:6824/1044755861 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5570141ca0 con 0x7f5550074af0 2024-04-27T02:38:42.542 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:42.542 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:42.542 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:42.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7f5550074af0 msgr2=0x7f5550076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6824/1044755861,v1:172.21.15.32:6825/1044755861] conn(0x7f5550074af0 0x7f5550076f10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f555006c8f0 msgr2=0x7f555006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f555006c8f0 0x7f555006edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5560009930 tx=0x7f5560008040 comp rx=0 tx=0).stop 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5570143590 msgr2=0x7f55701494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 --2- 172.21.15.16:0/1902153953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5570143590 0x7f55701494f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5568000f80 tx=0x7f556800e530 comp rx=0 tx=0).stop 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576200640 1 -- 172.21.15.16:0/1902153953 reap_dead start 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 shutdown_connections 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 >> 172.21.15.16:0/1902153953 conn(0x7f557009fa50 msgr2=0x7f5570148b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 shutdown_connections 2024-04-27T02:38:42.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.569+0000 7f5576c00640 1 -- 172.21.15.16:0/1902153953 wait complete. 2024-04-27T02:38:42.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-27T02:38:42.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.793+0000 7f3d47e00640 1 Processor -- start 2024-04-27T02:38:42.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.793+0000 7f3d47e00640 1 -- start start 2024-04-27T02:38:42.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.794+0000 7f3d47e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3d480afbd0 0x7f3d4814b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.794+0000 7f3d47e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 0x7f3d48152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.794+0000 7f3d47e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4814c200 con 0x7f3d480b6a90 2024-04-27T02:38:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.794+0000 7f3d47e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f3d48142a80 con 0x7f3d480afbd0 2024-04-27T02:38:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.794+0000 7f3d47e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f3d480b5b00 con 0x7f3d4814bd70 2024-04-27T02:38:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.795+0000 7f3d46a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3d480b6a90 0x7f3d480b3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47406/0 (socket says 172.21.15.16:47406) 2024-04-27T02:38:42.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.795+0000 7f3d46a00640 1 -- 172.21.15.16:0/4202102963 learned_addr learned my addr 172.21.15.16:0/4202102963 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.795+0000 7f3d47400640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 0x7f3d48152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.795+0000 7f3d46000640 1 --2- 172.21.15.16:0/4202102963 >> v2:172.21.15.32:3300/0 conn(0x7f3d480afbd0 0x7f3d4814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.795+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134588571 0 0) 0x7f3d4814c200 con 0x7f3d480b6a90 2024-04-27T02:38:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.795+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d2c003520 con 0x7f3d480b6a90 2024-04-27T02:38:42.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1214735370 0 0) 0x7f3d2c003520 con 0x7f3d480b6a90 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 msgr2=0x7f3d48152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 0x7f3d48152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 >> v2:172.21.15.32:3300/0 conn(0x7f3d480afbd0 msgr2=0x7f3d4814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 --2- 172.21.15.16:0/4202102963 >> v2:172.21.15.32:3300/0 conn(0x7f3d480afbd0 0x7f3d4814b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d480b6e70 con 0x7f3d480b6a90 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f3d38001670 con 0x7f3d480b6a90 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 >> v1:172.21.15.16:6789/0 conn(0x7f3d480b6a90 legacy=0x7f3d480b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 0x7f3d2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3d48142a80 con 0x7f3d2c0039b0 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f3d480b5b00 con 0x7f3d2c004d40 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c00ba90 con 0x7f3d4814bd70 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.796+0000 7f3d46a00640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d47400640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d46000640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 0x7f3d2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d46a00640 1 -- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 msgr2=0x7f3d2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d46a00640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 0x7f3d2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d46a00640 1 -- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c004d40 msgr2=0x7f3d2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d46a00640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d46a00640 1 -- 172.21.15.16:0/4202102963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c003520 con 0x7f3d2c0039b0 2024-04-27T02:38:42.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.797+0000 7f3d46000640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d4814bd70 0x7f3d2c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.798+0000 7f3d46a00640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c190 tx=0x7f3d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87bd484318f0cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38007c80 con 0x7f3d2c0039b0 2024-04-27T02:38:42.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d38005ad0 con 0x7f3d2c0039b0 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d45600640 1 -- 172.21.15.16:0/4202102963 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38007070 con 0x7f3d2c0039b0 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d47e00640 1 -- 172.21.15.16:0/4202102963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d2c0039b0 msgr2=0x7f3d2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d47e00640 1 --2- 172.21.15.16:0/4202102963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d2c0039b0 0x7f3d2c003dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c190 tx=0x7f3d2c005830 comp rx=0 tx=0).stop 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d47400640 1 -- 172.21.15.16:0/4202102963 reap_dead start 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d47e00640 1 -- 172.21.15.16:0/4202102963 shutdown_connections 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.799+0000 7f3d47e00640 1 -- 172.21.15.16:0/4202102963 >> 172.21.15.16:0/4202102963 conn(0x7f3d48068270 msgr2=0x7f3d48068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.800+0000 7f3d47e00640 1 -- 172.21.15.16:0/4202102963 shutdown_connections 2024-04-27T02:38:42.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.800+0000 7f3d47e00640 1 -- 172.21.15.16:0/4202102963 wait complete. 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.801+0000 7f3d47e00640 1 Processor -- start 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.802+0000 7f3d47e00640 1 -- start start 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d48141c50 0x7f3d48146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d48147210 0x7f3d481e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d4814b430 0x7f3d481e1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3d480b6030 con 0x7f3d4814b430 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f3d480b0b50 con 0x7f3d48141c50 2024-04-27T02:38:42.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f3d480ae8a0 con 0x7f3d48147210 2024-04-27T02:38:42.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d4814b430 0x7f3d481e1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d4814b430 0x7f3d481e1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38708/0 (socket says 172.21.15.16:38708) 2024-04-27T02:38:42.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47400640 1 -- 172.21.15.16:0/4123681770 learned_addr learned my addr 172.21.15.16:0/4123681770 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:42.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d46000640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d48147210 0x7f3d481e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d46a00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d48141c50 0x7f3d48146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.803+0000 7f3d47400640 1 -- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d48147210 msgr2=0x7f3d481e0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d47400640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d48147210 0x7f3d481e0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d47400640 1 -- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d48141c50 msgr2=0x7f3d48146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d47400640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d48141c50 0x7f3d48146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d47400640 1 -- 172.21.15.16:0/4123681770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d48142030 con 0x7f3d4814b430 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d47400640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d4814b430 0x7f3d481e1360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b0160 tx=0x7f3d400115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d3ea00640 1 -- 172.21.15.16:0/4123681770 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40011db0 con 0x7f3d4814b430 2024-04-27T02:38:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d3ea00640 1 -- 172.21.15.16:0/4123681770 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4001b070 con 0x7f3d4814b430 2024-04-27T02:38:42.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d3ea00640 1 -- 172.21.15.16:0/4123681770 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40003990 con 0x7f3d4814b430 2024-04-27T02:38:42.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d481489b0 con 0x7f3d4814b430 2024-04-27T02:38:42.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.804+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d48147800 con 0x7f3d4814b430 2024-04-27T02:38:42.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.806+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d48147a00 con 0x7f3d4814b430 2024-04-27T02:38:42.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.807+0000 7f3d3ea00640 1 -- 172.21.15.16:0/4123681770 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d40005d10 con 0x7f3d4814b430 2024-04-27T02:38:42.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.808+0000 7f3d3ea00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3d2806c920 0x7f3d2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:42.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.808+0000 7f3d3ea00640 1 -- 172.21.15.16:0/4123681770 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f3d4008c100 con 0x7f3d4814b430 2024-04-27T02:38:42.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.809+0000 7f3d46a00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3d2806c920 0x7f3d2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:42.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.810+0000 7f3d46a00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3d2806c920 0x7f3d2806ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3d38032000 tx=0x7f3d38009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:42.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:42.813+0000 7f3d3ea00640 1 -- 172.21.15.16:0/4123681770 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3d48147a00 con 0x7f3d4814b430 2024-04-27T02:38:42.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.022+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f3d48076600 con 0x7f3d2806c920 2024-04-27T02:38:42.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.024+0000 7f3d3ea00640 1 -- 172.21.15.16:0/4123681770 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d48076600 con 0x7f3d2806c920 2024-04-27T02:38:42.997 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-04-27T02:38:43.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.026+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3d2806c920 msgr2=0x7f3d2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.026+0000 7f3d47e00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3d2806c920 0x7f3d2806ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3d38032000 tx=0x7f3d38009030 comp rx=0 tx=0).stop 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.026+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d4814b430 msgr2=0x7f3d481e1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.026+0000 7f3d47e00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d4814b430 0x7f3d481e1360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b0160 tx=0x7f3d400115a0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 shutdown_connections 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f3d2806c920 0x7f3d2806ede0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d4814b430 0x7f3d481e1360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f3d48147210 0x7f3d481e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 --2- 172.21.15.16:0/4123681770 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d48141c50 0x7f3d48146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 >> 172.21.15.16:0/4123681770 conn(0x7f3d48068270 msgr2=0x7f3d48068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:43.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 shutdown_connections 2024-04-27T02:38:43.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.027+0000 7f3d47e00640 1 -- 172.21.15.16:0/4123681770 wait complete. 2024-04-27T02:38:43.021 INFO:tasks.ceph:Scrubbing osd.5 2024-04-27T02:38:43.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:43.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.265+0000 7f6eefe00640 1 Processor -- start 2024-04-27T02:38:43.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.265+0000 7f6eefe00640 1 -- start start 2024-04-27T02:38:43.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.266+0000 7f6eefe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ef00b6660 0x7f6ef014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.266+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 0x7f6ef0152c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.266+0000 7f6eefe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef00badd0 con 0x7f6ef014be10 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.266+0000 7f6eefe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef00ba5e0 con 0x7f6ef00b6660 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.266+0000 7f6eefe00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef00b78a0 con 0x7f6ef0142720 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.266+0000 7f6eeea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ef00b6660 0x7f6ef014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.267+0000 7f6eeea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ef00b6660 0x7f6ef014b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38712/0 (socket says 172.21.15.16:38712) 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.267+0000 7f6eeea00640 1 -- 172.21.15.16:0/4271601511 learned_addr learned my addr 172.21.15.16:0/4271601511 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.267+0000 7f6eee000640 1 --1- 172.21.15.16:0/4271601511 >> v1:172.21.15.16:6789/0 conn(0x7f6ef014be10 0x7f6ef0142010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47422/0 (socket says 172.21.15.16:47422) 2024-04-27T02:38:43.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.267+0000 7f6eeea00640 1 -- 172.21.15.16:0/4271601511 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 msgr2=0x7f6ef0152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:43.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.267+0000 7f6eeea00640 1 --2- 172.21.15.16:0/4271601511 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 0x7f6ef0152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.267+0000 7f6eeea00640 1 -- 172.21.15.16:0/4271601511 >> v1:172.21.15.16:6789/0 conn(0x7f6ef014be10 legacy=0x7f6ef0142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.267+0000 7f6eeea00640 1 -- 172.21.15.16:0/4271601511 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef014c270 con 0x7f6ef00b6660 2024-04-27T02:38:43.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.268+0000 7f6eeea00640 1 --2- 172.21.15.16:0/4271601511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00b6660 0x7f6ef014b8d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6ef014c440 tx=0x7f6ee002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cf4e0996df2b29 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.268+0000 7f6eed600640 1 -- 172.21.15.16:0/4271601511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0037070 con 0x7f6ef00b6660 2024-04-27T02:38:43.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.268+0000 7f6eed600640 1 -- 172.21.15.16:0/4271601511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0032440 con 0x7f6ef00b6660 2024-04-27T02:38:43.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.268+0000 7f6eed600640 1 -- 172.21.15.16:0/4271601511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0032810 con 0x7f6ef00b6660 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 -- 172.21.15.16:0/4271601511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00b6660 msgr2=0x7f6ef014b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 --2- 172.21.15.16:0/4271601511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00b6660 0x7f6ef014b8d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6ef014c440 tx=0x7f6ee002a250 comp rx=0 tx=0).stop 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 -- 172.21.15.16:0/4271601511 shutdown_connections 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 --2- 172.21.15.16:0/4271601511 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 0x7f6ef0152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 --2- 172.21.15.16:0/4271601511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef00b6660 0x7f6ef014b8d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 -- 172.21.15.16:0/4271601511 >> 172.21.15.16:0/4271601511 conn(0x7f6ef00684b0 msgr2=0x7f6ef00688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 -- 172.21.15.16:0/4271601511 shutdown_connections 2024-04-27T02:38:43.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.269+0000 7f6eefe00640 1 -- 172.21.15.16:0/4271601511 wait complete. 2024-04-27T02:38:43.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.271+0000 7f6eefe00640 1 Processor -- start 2024-04-27T02:38:43.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.271+0000 7f6eefe00640 1 -- start start 2024-04-27T02:38:43.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00b6660 0x7f6ef01d4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 0x7f6ef00bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef014be10 0x7f6ef01e1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eefe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef00b8190 con 0x7f6ef014be10 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eefe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef00b8010 con 0x7f6ef00b6660 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eefe00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef00b50e0 con 0x7f6ef0142720 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eef400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef014be10 0x7f6ef01e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eef400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef014be10 0x7f6ef01e1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38722/0 (socket says 172.21.15.16:38722) 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eef400640 1 -- 172.21.15.16:0/2598560070 learned_addr learned my addr 172.21.15.16:0/2598560070 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eeea00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00b6660 0x7f6ef01d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.272+0000 7f6eee000640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 0x7f6ef00bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eef400640 1 -- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 msgr2=0x7f6ef00bd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eef400640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f6ef0142720 0x7f6ef00bd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eef400640 1 -- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00b6660 msgr2=0x7f6ef01d4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eef400640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6ef00b6660 0x7f6ef01d4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eef400640 1 -- 172.21.15.16:0/2598560070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef0146280 con 0x7f6ef014be10 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eef400640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef014be10 0x7f6ef01e1520 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009fd0 tx=0x7f6ee800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8011830 con 0x7f6ef014be10 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee8016070 con 0x7f6ef014be10 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8011bf0 con 0x7f6ef014be10 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef0146560 con 0x7f6ef014be10 2024-04-27T02:38:43.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.273+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef01494a0 con 0x7f6ef014be10 2024-04-27T02:38:43.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.274+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ef0076600 con 0x7f6ef014be10 2024-04-27T02:38:43.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.275+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ee801b460 con 0x7f6ef014be10 2024-04-27T02:38:43.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.276+0000 7f6ee6a00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6ecc06c940 0x7f6ecc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.277+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f6ee808b860 con 0x7f6ef014be10 2024-04-27T02:38:43.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.277+0000 7f6ee6a00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f6ecc074c20 0x7f6ecc077040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.277+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 --> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ecc077710 con 0x7f6ecc074c20 2024-04-27T02:38:43.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.277+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6ee80902a0 con 0x7f6ef014be10 2024-04-27T02:38:43.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.277+0000 7f6eeea00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6ecc06c940 0x7f6ecc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.278+0000 7f6eee000640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f6ecc074c20 0x7f6ecc077040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.278+0000 7f6eeea00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6ecc06c940 0x7f6ecc06ee00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0034000 tx=0x7f6ee002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.279+0000 7f6eee000640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f6ecc074c20 0x7f6ecc077040 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.281+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== osd.5 v2:172.21.15.32:6800/2551335991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ecc077710 con 0x7f6ecc074c20 2024-04-27T02:38:43.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.296+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 --> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ef00b5460 con 0x7f6ecc074c20 2024-04-27T02:38:43.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.297+0000 7f6ee6a00640 1 -- 172.21.15.16:0/2598560070 <== osd.5 v2:172.21.15.32:6800/2551335991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ef00b5460 con 0x7f6ecc074c20 2024-04-27T02:38:43.270 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:43.271 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:43.271 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:43.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.297+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f6ecc074c20 msgr2=0x7f6ecc077040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.297+0000 7f6eefe00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6800/2551335991,v1:172.21.15.32:6801/2551335991] conn(0x7f6ecc074c20 0x7f6ecc077040 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6ecc06c940 msgr2=0x7f6ecc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f6ecc06c940 0x7f6ecc06ee00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0034000 tx=0x7f6ee002e000 comp rx=0 tx=0).stop 2024-04-27T02:38:43.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef014be10 msgr2=0x7f6ef01e1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 --2- 172.21.15.16:0/2598560070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ef014be10 0x7f6ef01e1520 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009fd0 tx=0x7f6ee800b8e0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eef400640 1 -- 172.21.15.16:0/2598560070 reap_dead start 2024-04-27T02:38:43.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 shutdown_connections 2024-04-27T02:38:43.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 >> 172.21.15.16:0/2598560070 conn(0x7f6ef00684b0 msgr2=0x7f6ef0149950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:43.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 shutdown_connections 2024-04-27T02:38:43.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.298+0000 7f6eefe00640 1 -- 172.21.15.16:0/2598560070 wait complete. 2024-04-27T02:38:43.290 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-27T02:38:43.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.524+0000 7f25c5200640 1 Processor -- start 2024-04-27T02:38:43.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.524+0000 7f25c5200640 1 -- start start 2024-04-27T02:38:43.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.526+0000 7f25c5200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25c00b6a90 0x7f25c00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.526+0000 7f25c5200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c00b6e70 con 0x7f25c00afbd0 2024-04-27T02:38:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.526+0000 7f25c5200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c00b5d50 con 0x7f25c014bf40 2024-04-27T02:38:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.526+0000 7f25c5200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f25c0142a80 con 0x7f25c00b6a90 2024-04-27T02:38:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.526+0000 7f25bf400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25c00b6a90 0x7f25c00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.526+0000 7f25bea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f25c00afbd0 0x7f25c014b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47436/0 (socket says 172.21.15.16:47436) 2024-04-27T02:38:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.526+0000 7f25bea00640 1 -- 172.21.15.16:0/2175038834 learned_addr learned my addr 172.21.15.16:0/2175038834 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.527+0000 7f25bf400640 1 -- 172.21.15.16:0/2175038834 >> v1:172.21.15.32:6789/0 conn(0x7f25c014bf40 legacy=0x7f25c0152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.527+0000 7f25bf400640 1 -- 172.21.15.16:0/2175038834 >> v1:172.21.15.16:6789/0 conn(0x7f25c00afbd0 legacy=0x7f25c014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.527+0000 7f25be000640 1 -- 172.21.15.16:0/2175038834 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188597217 0 0) 0x7f25c00b6e70 con 0x7f25c00afbd0 2024-04-27T02:38:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.527+0000 7f25bf400640 1 -- 172.21.15.16:0/2175038834 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c00b6030 con 0x7f25c00b6a90 2024-04-27T02:38:43.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.528+0000 7f25bf400640 1 --2- 172.21.15.16:0/2175038834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00b3780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f25b00097a0 tx=0x7f25b002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e240e8d29f06e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.528+0000 7f25be000640 1 -- 172.21.15.16:0/2175038834 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0037070 con 0x7f25c00b6a90 2024-04-27T02:38:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.528+0000 7f25be000640 1 -- 172.21.15.16:0/2175038834 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b0032440 con 0x7f25c00b6a90 2024-04-27T02:38:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.528+0000 7f25be000640 1 -- 172.21.15.16:0/2175038834 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b002ae60 con 0x7f25c00b6a90 2024-04-27T02:38:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.529+0000 7f25c5200640 1 -- 172.21.15.16:0/2175038834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 msgr2=0x7f25c00b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.529+0000 7f25c5200640 1 --2- 172.21.15.16:0/2175038834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00b3780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f25b00097a0 tx=0x7f25b002a110 comp rx=0 tx=0).stop 2024-04-27T02:38:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.529+0000 7f25c5200640 1 -- 172.21.15.16:0/2175038834 shutdown_connections 2024-04-27T02:38:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.529+0000 7f25c5200640 1 --2- 172.21.15.16:0/2175038834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00b3780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.529+0000 7f25c5200640 1 -- 172.21.15.16:0/2175038834 >> 172.21.15.16:0/2175038834 conn(0x7f25c0068270 msgr2=0x7f25c0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.529+0000 7f25c5200640 1 -- 172.21.15.16:0/2175038834 shutdown_connections 2024-04-27T02:38:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.529+0000 7f25c5200640 1 -- 172.21.15.16:0/2175038834 wait complete. 2024-04-27T02:38:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 Processor -- start 2024-04-27T02:38:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 -- start start 2024-04-27T02:38:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f25c00afbd0 0x7f25c01487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25c014bf40 0x7f25c0072a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25c00b0b50 con 0x7f25c00b6a90 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f25c00b5b00 con 0x7f25c014bf40 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.531+0000 7f25c5200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f25c0073cb0 con 0x7f25c00afbd0 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38748/0 (socket says 172.21.15.16:38748) 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 -- 172.21.15.16:0/849596932 learned_addr learned my addr 172.21.15.16:0/849596932 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bf400640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f25c00afbd0 0x7f25c01487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 -- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f25c00afbd0 msgr2=0x7f25c01487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bfe00640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25c014bf40 0x7f25c0072a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f25c00afbd0 0x7f25c01487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 -- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25c014bf40 msgr2=0x7f25c0072a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25c014bf40 0x7f25c0072a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.532+0000 7f25bea00640 1 -- 172.21.15.16:0/849596932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c0144100 con 0x7f25c00b6a90 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.533+0000 7f25bea00640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00724c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00c420 tx=0x7f25ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.533+0000 7f25b7400640 1 -- 172.21.15.16:0/849596932 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0074e0 con 0x7f25c00b6a90 2024-04-27T02:38:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.533+0000 7f25b7400640 1 -- 172.21.15.16:0/849596932 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac0047e0 con 0x7f25c00b6a90 2024-04-27T02:38:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.533+0000 7f25b7400640 1 -- 172.21.15.16:0/849596932 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac004c10 con 0x7f25c00b6a90 2024-04-27T02:38:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.533+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c0071cc0 con 0x7f25c00b6a90 2024-04-27T02:38:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.533+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c0143330 con 0x7f25c00b6a90 2024-04-27T02:38:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.534+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c0076600 con 0x7f25c00b6a90 2024-04-27T02:38:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.535+0000 7f25b7400640 1 -- 172.21.15.16:0/849596932 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25ac011070 con 0x7f25c00b6a90 2024-04-27T02:38:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.536+0000 7f25b7400640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f25a006c8f0 0x7f25a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.536+0000 7f25b7400640 1 -- 172.21.15.16:0/849596932 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f25ac08b700 con 0x7f25c00b6a90 2024-04-27T02:38:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.537+0000 7f25bf400640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f25a006c8f0 0x7f25a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.538+0000 7f25bf400640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f25a006c8f0 0x7f25a006edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25b0034000 tx=0x7f25b002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.540+0000 7f25b7400640 1 -- 172.21.15.16:0/849596932 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f25ac00e280 con 0x7f25c00b6a90 2024-04-27T02:38:43.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.748+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f25c0072160 con 0x7f25a006c8f0 2024-04-27T02:38:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.750+0000 7f25b7400640 1 -- 172.21.15.16:0/849596932 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f25c0072160 con 0x7f25a006c8f0 2024-04-27T02:38:43.723 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-04-27T02:38:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.752+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f25a006c8f0 msgr2=0x7f25a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.752+0000 7f25c5200640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f25a006c8f0 0x7f25a006edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25b0034000 tx=0x7f25b002e000 comp rx=0 tx=0).stop 2024-04-27T02:38:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 msgr2=0x7f25c00724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00724c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00c420 tx=0x7f25ac00c8e0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 shutdown_connections 2024-04-27T02:38:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f25a006c8f0 0x7f25a006edb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25c014bf40 0x7f25c0072a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c00b6a90 0x7f25c00724c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 --2- 172.21.15.16:0/849596932 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f25c00afbd0 0x7f25c01487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 >> 172.21.15.16:0/849596932 conn(0x7f25c0068270 msgr2=0x7f25c00b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 shutdown_connections 2024-04-27T02:38:43.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.753+0000 7f25c5200640 1 -- 172.21.15.16:0/849596932 wait complete. 2024-04-27T02:38:43.745 INFO:tasks.ceph:Scrubbing osd.6 2024-04-27T02:38:43.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:43.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.992+0000 7f96a5c00640 1 Processor -- start 2024-04-27T02:38:43.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.992+0000 7f96a5c00640 1 -- start start 2024-04-27T02:38:43.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.993+0000 7f96a5c00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96a009eed0 0x7f96a01499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.993+0000 7f96a5c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96a00b13f0 0x7f96a0149f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.993+0000 7f96a5c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b3840 0x7f96a014a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f96a5c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f96a00b30f0 con 0x7f96a00b13f0 2024-04-27T02:38:43.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f96a5c00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f96a00b3fa0 con 0x7f96a009eed0 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f96a5c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f96a009f2b0 con 0x7f96a00b3840 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96a00b13f0 0x7f96a0149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96a00b13f0 0x7f96a0149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38762/0 (socket says 172.21.15.16:38762) 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 -- 172.21.15.16:0/3924497355 learned_addr learned my addr 172.21.15.16:0/3924497355 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969ea00640 1 --2- 172.21.15.16:0/3924497355 >> v2:172.21.15.32:3300/0 conn(0x7f96a009eed0 0x7f96a01499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 -- 172.21.15.16:0/3924497355 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b3840 msgr2=0x7f96a014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969f400640 1 --2- 172.21.15.16:0/3924497355 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b3840 0x7f96a014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 --2- 172.21.15.16:0/3924497355 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b3840 0x7f96a014a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 -- 172.21.15.16:0/3924497355 >> v2:172.21.15.32:3300/0 conn(0x7f96a009eed0 msgr2=0x7f96a01499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:43.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 --2- 172.21.15.16:0/3924497355 >> v2:172.21.15.32:3300/0 conn(0x7f96a009eed0 0x7f96a01499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969e000640 1 -- 172.21.15.16:0/3924497355 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00b1910 con 0x7f96a00b13f0 2024-04-27T02:38:43.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.994+0000 7f969f400640 1 --2- 172.21.15.16:0/3924497355 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b3840 0x7f96a014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:43.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.996+0000 7f969e000640 1 --2- 172.21.15.16:0/3924497355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a00b13f0 0x7f96a0149f00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96a006ed30 tx=0x7f968c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4905fbe52bd9318 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.996+0000 7f969d600640 1 -- 172.21.15.16:0/3924497355 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c037070 con 0x7f96a00b13f0 2024-04-27T02:38:43.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.996+0000 7f969d600640 1 -- 172.21.15.16:0/3924497355 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c02ae00 con 0x7f96a00b13f0 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.996+0000 7f969d600640 1 -- 172.21.15.16:0/3924497355 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c032660 con 0x7f96a00b13f0 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 -- 172.21.15.16:0/3924497355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a00b13f0 msgr2=0x7f96a0149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 --2- 172.21.15.16:0/3924497355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a00b13f0 0x7f96a0149f00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96a006ed30 tx=0x7f968c02a0b0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 -- 172.21.15.16:0/3924497355 shutdown_connections 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 --2- 172.21.15.16:0/3924497355 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b3840 0x7f96a014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 --2- 172.21.15.16:0/3924497355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a00b13f0 0x7f96a0149f00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 --2- 172.21.15.16:0/3924497355 >> v2:172.21.15.32:3300/0 conn(0x7f96a009eed0 0x7f96a01499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 -- 172.21.15.16:0/3924497355 >> 172.21.15.16:0/3924497355 conn(0x7f96a00b9f50 msgr2=0x7f96a00ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:43.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 -- 172.21.15.16:0/3924497355 shutdown_connections 2024-04-27T02:38:43.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.997+0000 7f96a5c00640 1 -- 172.21.15.16:0/3924497355 wait complete. 2024-04-27T02:38:43.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.998+0000 7f96a5c00640 1 Processor -- start 2024-04-27T02:38:43.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.999+0000 7f96a5c00640 1 -- start start 2024-04-27T02:38:43.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.999+0000 7f96a5c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a009eed0 0x7f96a009bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.999+0000 7f96a5c00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b13f0 0x7f96a00b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.999+0000 7f96a5c00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a00b3840 0x7f96a009c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.999+0000 7f96a5c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00b11b0 con 0x7f96a009eed0 2024-04-27T02:38:43.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.999+0000 7f96a5c00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00b1030 con 0x7f96a00b3840 2024-04-27T02:38:43.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:43.999+0000 7f96a5c00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f96a01463f0 con 0x7f96a00b13f0 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a009eed0 0x7f96a009bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a009eed0 0x7f96a009bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38778/0 (socket says 172.21.15.16:38778) 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 -- 172.21.15.16:0/1061996341 learned_addr learned my addr 172.21.15.16:0/1061996341 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969e000640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b13f0 0x7f96a00b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969f400640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a00b3840 0x7f96a009c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 -- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b13f0 msgr2=0x7f96a00b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f96a00b13f0 0x7f96a00b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 -- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a00b3840 msgr2=0x7f96a009c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:43.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96a00b3840 0x7f96a009c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.000+0000 7f969ea00640 1 -- 172.21.15.16:0/1061996341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a0148860 con 0x7f96a009eed0 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.001+0000 7f969ea00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a009eed0 0x7f96a009bc90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f969000d800 tx=0x7f969000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.001+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690018020 con 0x7f96a009eed0 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.001+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96900096a0 con 0x7f96a009eed0 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.001+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690009a70 con 0x7f96a009eed0 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.001+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a009cf10 con 0x7f96a009eed0 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.001+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a009e8a0 con 0x7f96a009eed0 2024-04-27T02:38:43.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.002+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96a00693a0 con 0x7f96a009eed0 2024-04-27T02:38:43.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.003+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f969001b020 con 0x7f96a009eed0 2024-04-27T02:38:43.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.004+0000 7f9696a00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f968006c920 0x7f968006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.004+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f969008bd40 con 0x7f96a009eed0 2024-04-27T02:38:43.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.004+0000 7f9696a00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7f9680074b80 0x7f9680076fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:43.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.004+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 --> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9680077670 con 0x7f9680074b80 2024-04-27T02:38:43.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.004+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f969008e300 con 0x7f96a009eed0 2024-04-27T02:38:43.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.005+0000 7f969e000640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f968006c920 0x7f968006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.005+0000 7f969f400640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7f9680074b80 0x7f9680076fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:43.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.006+0000 7f969e000640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f968006c920 0x7f968006ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f968c034000 tx=0x7f968c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.006+0000 7f969f400640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7f9680074b80 0x7f9680076fa0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:43.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.009+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== osd.6 v2:172.21.15.32:6816/2056422341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9680077670 con 0x7f9680074b80 2024-04-27T02:38:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.023+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 --> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f96a0144950 con 0x7f9680074b80 2024-04-27T02:38:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.024+0000 7f9696a00640 1 -- 172.21.15.16:0/1061996341 <== osd.6 v2:172.21.15.32:6816/2056422341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f96a0144950 con 0x7f9680074b80 2024-04-27T02:38:43.998 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:43.998 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:43.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7f9680074b80 msgr2=0x7f9680076fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6816/2056422341,v1:172.21.15.32:6817/2056422341] conn(0x7f9680074b80 0x7f9680076fa0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f968006c920 msgr2=0x7f968006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f968006c920 0x7f968006ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f968c034000 tx=0x7f968c02e000 comp rx=0 tx=0).stop 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a009eed0 msgr2=0x7f96a009bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 --2- 172.21.15.16:0/1061996341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a009eed0 0x7f96a009bc90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f969000d800 tx=0x7f969000dcc0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f969f400640 1 -- 172.21.15.16:0/1061996341 reap_dead start 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 shutdown_connections 2024-04-27T02:38:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.025+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 >> 172.21.15.16:0/1061996341 conn(0x7f96a00b9f50 msgr2=0x7f96a00b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:44.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.026+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 shutdown_connections 2024-04-27T02:38:44.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.026+0000 7f96a5c00640 1 -- 172.21.15.16:0/1061996341 wait complete. 2024-04-27T02:38:44.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-27T02:38:44.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.253+0000 7fbd5d800640 1 Processor -- start 2024-04-27T02:38:44.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.253+0000 7fbd5d800640 1 -- start start 2024-04-27T02:38:44.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.254+0000 7fbd5d800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbd580b6760 0x7fbd58146e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.254+0000 7fbd5d800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd5806fa10 0x7fbd58150c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.254+0000 7fbd5d800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd58146340 con 0x7fbd580b29d0 2024-04-27T02:38:44.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.254+0000 7fbd5d800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbd580b2db0 con 0x7fbd580b6760 2024-04-27T02:38:44.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.254+0000 7fbd5d800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fbd58146970 con 0x7fbd5806fa10 2024-04-27T02:38:44.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd4e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbd580b6760 0x7fbd58146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd4e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbd580b6760 0x7fbd58146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38792/0 (socket says 172.21.15.16:38792) 2024-04-27T02:38:44.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd4e000640 1 -- 172.21.15.16:0/901074157 learned_addr learned my addr 172.21.15.16:0/901074157 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:44.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd57400640 1 --2- 172.21.15.16:0/901074157 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd5806fa10 0x7fbd58150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd4e000640 1 -- 172.21.15.16:0/901074157 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd5806fa10 msgr2=0x7fbd58150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd4e000640 1 --2- 172.21.15.16:0/901074157 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd5806fa10 0x7fbd58150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd4e000640 1 -- 172.21.15.16:0/901074157 >> v1:172.21.15.16:6789/0 conn(0x7fbd580b29d0 legacy=0x7fbd580734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd4e000640 1 -- 172.21.15.16:0/901074157 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd58070f10 con 0x7fbd580b6760 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd56000640 1 -- 172.21.15.16:0/901074157 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186905704 0 0) 0x7fbd58146340 con 0x7fbd580b29d0 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.255+0000 7fbd57400640 1 --2- 172.21.15.16:0/901074157 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd5806fa10 0x7fbd58150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.257+0000 7fbd4e000640 1 --2- 172.21.15.16:0/901074157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b6760 0x7fbd58146e00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009870 tx=0x7fbd4002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d18152bbbcc0237 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.257+0000 7fbd56000640 1 -- 172.21.15.16:0/901074157 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40037070 con 0x7fbd580b6760 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.257+0000 7fbd56000640 1 -- 172.21.15.16:0/901074157 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd40032440 con 0x7fbd580b6760 2024-04-27T02:38:44.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.257+0000 7fbd56000640 1 -- 172.21.15.16:0/901074157 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40032810 con 0x7fbd580b6760 2024-04-27T02:38:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.257+0000 7fbd5d800640 1 -- 172.21.15.16:0/901074157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b6760 msgr2=0x7fbd58146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.257+0000 7fbd5d800640 1 --2- 172.21.15.16:0/901074157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b6760 0x7fbd58146e00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009870 tx=0x7fbd4002a130 comp rx=0 tx=0).stop 2024-04-27T02:38:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.258+0000 7fbd5d800640 1 -- 172.21.15.16:0/901074157 shutdown_connections 2024-04-27T02:38:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.258+0000 7fbd5d800640 1 --2- 172.21.15.16:0/901074157 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd5806fa10 0x7fbd58150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.258+0000 7fbd5d800640 1 --2- 172.21.15.16:0/901074157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b6760 0x7fbd58146e00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.258+0000 7fbd5d800640 1 -- 172.21.15.16:0/901074157 >> 172.21.15.16:0/901074157 conn(0x7fbd580b8860 msgr2=0x7fbd580b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:44.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.258+0000 7fbd5d800640 1 -- 172.21.15.16:0/901074157 shutdown_connections 2024-04-27T02:38:44.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.258+0000 7fbd5d800640 1 -- 172.21.15.16:0/901074157 wait complete. 2024-04-27T02:38:44.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.259+0000 7fbd5d800640 1 Processor -- start 2024-04-27T02:38:44.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.259+0000 7fbd5d800640 1 -- start start 2024-04-27T02:38:44.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.260+0000 7fbd5d800640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5806fa10 0x7fbd581e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.260+0000 7fbd5d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b29d0 0x7fbd5806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.260+0000 7fbd5d800640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd580b6760 0x7fbd5813ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.260+0000 7fbd5d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5806fe60 con 0x7fbd580b29d0 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.260+0000 7fbd5d800640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fbd58070b50 con 0x7fbd5806fa10 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.260+0000 7fbd5d800640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5806ffe0 con 0x7fbd580b6760 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b29d0 0x7fbd5806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b29d0 0x7fbd5806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38798/0 (socket says 172.21.15.16:38798) 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 -- 172.21.15.16:0/1539464 learned_addr learned my addr 172.21.15.16:0/1539464 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd57400640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd580b6760 0x7fbd5813ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd56a00640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5806fa10 0x7fbd581e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 -- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd580b6760 msgr2=0x7fbd5813ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd580b6760 0x7fbd5813ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 -- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5806fa10 msgr2=0x7fbd581e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5806fa10 0x7fbd581e66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd4e000640 1 -- 172.21.15.16:0/1539464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd58145e80 con 0x7fbd580b29d0 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.261+0000 7fbd56a00640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5806fa10 0x7fbd581e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.262+0000 7fbd4e000640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b29d0 0x7fbd5806d6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002a170 tx=0x7fbd400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.262+0000 7fbd4f400640 1 -- 172.21.15.16:0/1539464 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40037040 con 0x7fbd580b29d0 2024-04-27T02:38:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.262+0000 7fbd4f400640 1 -- 172.21.15.16:0/1539464 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd40042070 con 0x7fbd580b29d0 2024-04-27T02:38:44.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.262+0000 7fbd4f400640 1 -- 172.21.15.16:0/1539464 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40030bd0 con 0x7fbd580b29d0 2024-04-27T02:38:44.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.262+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd580b5f70 con 0x7fbd580b29d0 2024-04-27T02:38:44.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.262+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd581e5bf0 con 0x7fbd580b29d0 2024-04-27T02:38:44.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.263+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd58069b20 con 0x7fbd580b29d0 2024-04-27T02:38:44.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.264+0000 7fbd4f400640 1 -- 172.21.15.16:0/1539464 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd40047460 con 0x7fbd580b29d0 2024-04-27T02:38:44.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.265+0000 7fbd4f400640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fbd3406c940 0x7fbd3406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.265+0000 7fbd4f400640 1 -- 172.21.15.16:0/1539464 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7fbd400ac770 con 0x7fbd580b29d0 2024-04-27T02:38:44.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.266+0000 7fbd56a00640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fbd3406c940 0x7fbd3406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.267+0000 7fbd56a00640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fbd3406c940 0x7fbd3406ee00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbd48000f60 tx=0x7fbd48009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.270+0000 7fbd4f400640 1 -- 172.21.15.16:0/1539464 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbd58069b20 con 0x7fbd580b29d0 2024-04-27T02:38:44.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.476+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbd581e61e0 con 0x7fbd3406c940 2024-04-27T02:38:44.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.478+0000 7fbd4f400640 1 -- 172.21.15.16:0/1539464 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbd581e61e0 con 0x7fbd3406c940 2024-04-27T02:38:44.452 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-04-27T02:38:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fbd3406c940 msgr2=0x7fbd3406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fbd3406c940 0x7fbd3406ee00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbd48000f60 tx=0x7fbd48009040 comp rx=0 tx=0).stop 2024-04-27T02:38:44.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b29d0 msgr2=0x7fbd5806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b29d0 0x7fbd5806d6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002a170 tx=0x7fbd400046c0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 shutdown_connections 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fbd3406c940 0x7fbd3406ee00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fbd580b6760 0x7fbd5813ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd580b29d0 0x7fbd5806d6b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 --2- 172.21.15.16:0/1539464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd5806fa10 0x7fbd581e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.480+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 >> 172.21.15.16:0/1539464 conn(0x7fbd580b8860 msgr2=0x7fbd58073360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:44.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.481+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 shutdown_connections 2024-04-27T02:38:44.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.481+0000 7fbd5d800640 1 -- 172.21.15.16:0/1539464 wait complete. 2024-04-27T02:38:44.473 INFO:tasks.ceph:Scrubbing osd.7 2024-04-27T02:38:44.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-27T02:38:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.718+0000 7f640f000640 1 Processor -- start 2024-04-27T02:38:44.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.718+0000 7f640f000640 1 -- start start 2024-04-27T02:38:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f640f000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f640f000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64080b3840 0x7f6408150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f640f000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64080b3fa0 con 0x7f64080b13f0 2024-04-27T02:38:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f640f000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f64080b30f0 con 0x7f64080b3840 2024-04-27T02:38:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f640f000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f6408147400 con 0x7f640809eed0 2024-04-27T02:38:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f640d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64080b3840 0x7f6408150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f63ffe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f64080b13f0 0x7f6408149f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47466/0 (socket says 172.21.15.16:47466) 2024-04-27T02:38:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.719+0000 7f63ffe00640 1 -- 172.21.15.16:0/1149658330 learned_addr learned my addr 172.21.15.16:0/1149658330 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f6407e00640 1 --2- 172.21.15.16:0/1149658330 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f6407400640 1 -- 172.21.15.16:0/1149658330 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818442090 0 0) 0x7f64080b3fa0 con 0x7f64080b13f0 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f6407400640 1 -- 172.21.15.16:0/1149658330 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63ec003520 con 0x7f64080b13f0 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f640d000640 1 -- 172.21.15.16:0/1149658330 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 msgr2=0x7f64081499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f640d000640 1 --2- 172.21.15.16:0/1149658330 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f640d000640 1 -- 172.21.15.16:0/1149658330 >> v1:172.21.15.16:6789/0 conn(0x7f64080b13f0 legacy=0x7f6408149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f640d000640 1 -- 172.21.15.16:0/1149658330 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640809f2b0 con 0x7f64080b3840 2024-04-27T02:38:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.720+0000 7f6407e00640 1 --2- 172.21.15.16:0/1149658330 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T02:38:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.721+0000 7f640d000640 1 --2- 172.21.15.16:0/1149658330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b3840 0x7f6408150d50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6400009d90 tx=0x7f640002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277c31a6f74f7b13 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.721+0000 7f6407400640 1 -- 172.21.15.16:0/1149658330 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400007740 con 0x7f64080b3840 2024-04-27T02:38:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.721+0000 7f6407400640 1 -- 172.21.15.16:0/1149658330 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64000078e0 con 0x7f64080b3840 2024-04-27T02:38:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.721+0000 7f6407400640 1 -- 172.21.15.16:0/1149658330 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400007c90 con 0x7f64080b3840 2024-04-27T02:38:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 -- 172.21.15.16:0/1149658330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b3840 msgr2=0x7f6408150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 --2- 172.21.15.16:0/1149658330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b3840 0x7f6408150d50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6400009d90 tx=0x7f640002a530 comp rx=0 tx=0).stop 2024-04-27T02:38:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 -- 172.21.15.16:0/1149658330 shutdown_connections 2024-04-27T02:38:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 --2- 172.21.15.16:0/1149658330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b3840 0x7f6408150d50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 --2- 172.21.15.16:0/1149658330 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 -- 172.21.15.16:0/1149658330 >> 172.21.15.16:0/1149658330 conn(0x7f64080b9f50 msgr2=0x7f64080ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 -- 172.21.15.16:0/1149658330 shutdown_connections 2024-04-27T02:38:44.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.722+0000 7f640f000640 1 -- 172.21.15.16:0/1149658330 wait complete. 2024-04-27T02:38:44.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.724+0000 7f640f000640 1 Processor -- start 2024-04-27T02:38:44.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.724+0000 7f640f000640 1 -- start start 2024-04-27T02:38:44.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f640f000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081e1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f640f000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b13f0 0x7f640809e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f640f000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64080b3840 0x7f6408070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f640f000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64080b1030 con 0x7f64080b13f0 2024-04-27T02:38:44.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f640f000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f6408073ec0 con 0x7f64080b3840 2024-04-27T02:38:44.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f640f000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f64080b11b0 con 0x7f640809eed0 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b13f0 0x7f640809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b13f0 0x7f640809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38810/0 (socket says 172.21.15.16:38810) 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 -- 172.21.15.16:0/1164355526 learned_addr learned my addr 172.21.15.16:0/1164355526 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f6407e00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081e1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f640d000640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64080b3840 0x7f6408070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 -- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 msgr2=0x7f64081e1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f640809eed0 0x7f64081e1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 -- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64080b3840 msgr2=0x7f6408070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64080b3840 0x7f6408070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.725+0000 7f63ffe00640 1 -- 172.21.15.16:0/1164355526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64081e1a10 con 0x7f64080b13f0 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.726+0000 7f63ffe00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b13f0 0x7f640809e230 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c430 tx=0x7f63f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.726+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0017070 con 0x7f64080b13f0 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.726+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f0005ce0 con 0x7f64080b13f0 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.726+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6408070780 con 0x7f64080b13f0 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.726+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00072f0 con 0x7f64080b13f0 2024-04-27T02:38:44.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.726+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6408071a60 con 0x7f64080b13f0 2024-04-27T02:38:44.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.727+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64080693a0 con 0x7f64080b13f0 2024-04-27T02:38:44.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.728+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f63f001a070 con 0x7f64080b13f0 2024-04-27T02:38:44.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.729+0000 7f6404c00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f63e406c8f0 0x7f63e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.729+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f63f008b060 con 0x7f64080b13f0 2024-04-27T02:38:44.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.729+0000 7f6404c00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7f63e4074b50 0x7f63e4076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.729+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 --> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63f0015e70 con 0x7f63e4074b50 2024-04-27T02:38:44.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.730+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f63f0092050 con 0x7f64080b13f0 2024-04-27T02:38:44.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.730+0000 7f6407e00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f63e406c8f0 0x7f63e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.730+0000 7f640d000640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7f63e4074b50 0x7f63e4076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.731+0000 7f6407e00640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f63e406c8f0 0x7f63e406edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f63f8006fd0 tx=0x7f63f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.731+0000 7f640d000640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7f63e4074b50 0x7f63e4076f70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.734+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== osd.7 v2:172.21.15.32:6808/4001400243 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63f0015e70 con 0x7f63e4074b50 2024-04-27T02:38:44.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.749+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 --> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f64080b7d00 con 0x7f63e4074b50 2024-04-27T02:38:44.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.750+0000 7f6404c00640 1 -- 172.21.15.16:0/1164355526 <== osd.7 v2:172.21.15.32:6808/4001400243 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f64080b7d00 con 0x7f63e4074b50 2024-04-27T02:38:44.724 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-27T02:38:44.724 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-27T02:38:44.724 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-27T02:38:44.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7f63e4074b50 msgr2=0x7f63e4076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6808/4001400243,v1:172.21.15.32:6809/4001400243] conn(0x7f63e4074b50 0x7f63e4076f70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f63e406c8f0 msgr2=0x7f63e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f63e406c8f0 0x7f63e406edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f63f8006fd0 tx=0x7f63f8008040 comp rx=0 tx=0).stop 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b13f0 msgr2=0x7f640809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 --2- 172.21.15.16:0/1164355526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64080b13f0 0x7f640809e230 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c430 tx=0x7f63f000c8f0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640d000640 1 -- 172.21.15.16:0/1164355526 reap_dead start 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 shutdown_connections 2024-04-27T02:38:44.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 >> 172.21.15.16:0/1164355526 conn(0x7f64080b9f50 msgr2=0x7f6408140180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 shutdown_connections 2024-04-27T02:38:44.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.751+0000 7f640f000640 1 -- 172.21.15.16:0/1164355526 wait complete. 2024-04-27T02:38:44.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-27T02:38:44.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.973+0000 7f574be00640 1 Processor -- start 2024-04-27T02:38:44.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.974+0000 7f574be00640 1 -- start start 2024-04-27T02:38:44.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.975+0000 7f574be00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f574c0afbd0 0x7f574c14b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.975+0000 7f574be00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574c14c200 con 0x7f574c0b6a90 2024-04-27T02:38:44.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.975+0000 7f574be00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574c0b6e70 con 0x7f574c14bd70 2024-04-27T02:38:44.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.975+0000 7f574be00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f574c142a80 con 0x7f574c0afbd0 2024-04-27T02:38:44.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.975+0000 7f574aa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f574c0b6a90 0x7f574c0b3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47470/0 (socket says 172.21.15.16:47470) 2024-04-27T02:38:44.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.975+0000 7f574aa00640 1 -- 172.21.15.16:0/1064371209 learned_addr learned my addr 172.21.15.16:0/1064371209 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:38:44.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f5743e00640 1 --2- 172.21.15.16:0/1064371209 >> v2:172.21.15.32:3300/0 conn(0x7f574c0afbd0 0x7f574c14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801386686 0 0) 0x7f574c14c200 con 0x7f574c0b6a90 2024-04-27T02:38:44.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5730003520 con 0x7f574c0b6a90 2024-04-27T02:38:44.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 469415541 0 0) 0x7f5730003520 con 0x7f574c0b6a90 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 >> v2:172.21.15.32:3300/0 conn(0x7f574c0afbd0 msgr2=0x7f574c14b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 --2- 172.21.15.16:0/1064371209 >> v2:172.21.15.32:3300/0 conn(0x7f574c0afbd0 0x7f574c14b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 >> v1:172.21.15.32:6789/0 conn(0x7f574c14bd70 legacy=0x7f574c152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c0b5d50 con 0x7f574c0b6a90 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f573c001670 con 0x7f574c0b6a90 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 >> v1:172.21.15.16:6789/0 conn(0x7f574c0b6a90 legacy=0x7f574c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5730003a00 0x7f5730003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5730004800 0x7f5730004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57300052e0 0x7f573000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f574c142a80 con 0x7f5730004800 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f573000c1e0 con 0x7f57300052e0 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.976+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f573000c3e0 con 0x7f5730003a00 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f5743e00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5730004800 0x7f5730004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f574aa00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5730003a00 0x7f5730003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f5743e00640 1 -- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5730003a00 msgr2=0x7f5730003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f5743e00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5730003a00 0x7f5730003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f5743e00640 1 -- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57300052e0 msgr2=0x7f573000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f5743e00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f57300052e0 0x7f573000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f5743e00640 1 -- 172.21.15.16:0/1064371209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5730003520 con 0x7f5730004800 2024-04-27T02:38:44.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f574b400640 1 -- 172.21.15.16:0/1064371209 reap_dead start 2024-04-27T02:38:44.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.977+0000 7f574aa00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5730003a00 0x7f5730003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:44.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.978+0000 7f5743e00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5730004800 0x7f5730004c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5734009ac0 tx=0x7f5730005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9029e2c11b26ae35 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734036070 con 0x7f5730004800 2024-04-27T02:38:44.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5734031400 con 0x7f5730004800 2024-04-27T02:38:44.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574a000640 1 -- 172.21.15.16:0/1064371209 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734009690 con 0x7f5730004800 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574be00640 1 -- 172.21.15.16:0/1064371209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5730004800 msgr2=0x7f5730004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574be00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5730004800 0x7f5730004c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5734009ac0 tx=0x7f5730005830 comp rx=0 tx=0).stop 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574be00640 1 -- 172.21.15.16:0/1064371209 shutdown_connections 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574be00640 1 --2- 172.21.15.16:0/1064371209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5730004800 0x7f5730004c80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.979+0000 7f574be00640 1 -- 172.21.15.16:0/1064371209 >> 172.21.15.16:0/1064371209 conn(0x7f574c068270 msgr2=0x7f574c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.980+0000 7f574be00640 1 -- 172.21.15.16:0/1064371209 shutdown_connections 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.980+0000 7f574be00640 1 -- 172.21.15.16:0/1064371209 wait complete. 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.981+0000 7f574be00640 1 Processor -- start 2024-04-27T02:38:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.981+0000 7f574be00640 1 -- start start 2024-04-27T02:38:44.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.982+0000 7f574be00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5730004800 0x7f574c13dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.982+0000 7f574be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c1dde30 0x7f574c1de290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.982+0000 7f574be00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f574c1e1110 0x7f574c1e1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.982+0000 7f574be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f574c0b0b50 con 0x7f574c1dde30 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.982+0000 7f574be00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f574c0b5b00 con 0x7f5730004800 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.982+0000 7f574be00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f574c0ae8a0 con 0x7f574c1e1110 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c1dde30 0x7f574c1de290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c1dde30 0x7f574c1de290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38838/0 (socket says 172.21.15.16:38838) 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 -- 172.21.15.16:0/2151089000 learned_addr learned my addr 172.21.15.16:0/2151089000 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f574aa00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5730004800 0x7f574c13dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f574b400640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f574c1e1110 0x7f574c1e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 -- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f574c1e1110 msgr2=0x7f574c1e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f574c1e1110 0x7f574c1e1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 -- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5730004800 msgr2=0x7f574c13dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5730004800 0x7f574c13dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 -- 172.21.15.16:0/2151089000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c143020 con 0x7f574c1dde30 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f574aa00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5730004800 0x7f574c13dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.983+0000 7f5743e00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c1dde30 0x7f574c1de290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f573402abb0 tx=0x7f5734004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.984+0000 7f5742a00640 1 -- 172.21.15.16:0/2151089000 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573403f030 con 0x7f574c1dde30 2024-04-27T02:38:44.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.984+0000 7f5742a00640 1 -- 172.21.15.16:0/2151089000 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57340039c0 con 0x7f574c1dde30 2024-04-27T02:38:44.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.984+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c073440 con 0x7f574c1dde30 2024-04-27T02:38:44.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.984+0000 7f5742a00640 1 -- 172.21.15.16:0/2151089000 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734036040 con 0x7f574c1dde30 2024-04-27T02:38:44.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.984+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c13ce40 con 0x7f574c1dde30 2024-04-27T02:38:44.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.985+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f574c076600 con 0x7f574c1dde30 2024-04-27T02:38:44.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.986+0000 7f5742a00640 1 -- 172.21.15.16:0/2151089000 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5734042070 con 0x7f574c1dde30 2024-04-27T02:38:44.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.987+0000 7f5742a00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f572806c920 0x7f572806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:44.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.987+0000 7f5742a00640 1 -- 172.21.15.16:0/2151089000 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f57340ab170 con 0x7f574c1dde30 2024-04-27T02:38:44.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.987+0000 7f574aa00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f572806c920 0x7f572806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:44.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.989+0000 7f574aa00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f572806c920 0x7f572806ede0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f573c001eb0 tx=0x7f573c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:44.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:44.991+0000 7f5742a00640 1 -- 172.21.15.16:0/2151089000 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5734078e90 con 0x7f574c1dde30 2024-04-27T02:38:45.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.201+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f574c13f7c0 con 0x7f572806c920 2024-04-27T02:38:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.203+0000 7f5742a00640 1 -- 172.21.15.16:0/2151089000 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f574c13f7c0 con 0x7f572806c920 2024-04-27T02:38:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-04-27T02:38:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f572806c920 msgr2=0x7f572806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f572806c920 0x7f572806ede0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f573c001eb0 tx=0x7f573c009040 comp rx=0 tx=0).stop 2024-04-27T02:38:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c1dde30 msgr2=0x7f574c1de290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c1dde30 0x7f574c1de290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f573402abb0 tx=0x7f5734004730 comp rx=0 tx=0).stop 2024-04-27T02:38:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 shutdown_connections 2024-04-27T02:38:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f572806c920 0x7f572806ede0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f574c1e1110 0x7f574c1e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f574c1dde30 0x7f574c1de290 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 --2- 172.21.15.16:0/2151089000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5730004800 0x7f574c13dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 >> 172.21.15.16:0/2151089000 conn(0x7f574c068270 msgr2=0x7f574c0b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:45.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 shutdown_connections 2024-04-27T02:38:45.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.206+0000 7f574be00640 1 -- 172.21.15.16:0/2151089000 wait complete. 2024-04-27T02:38:45.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-27T02:38:45.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.441+0000 7f41d7200640 1 Processor -- start 2024-04-27T02:38:45.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.441+0000 7f41d7200640 1 -- start start 2024-04-27T02:38:45.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.442+0000 7f41d7200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41d014bf40 0x7f41d0153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:45.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.443+0000 7f41d7200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d00b6e70 con 0x7f41d00b6a90 2024-04-27T02:38:45.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.443+0000 7f41d7200640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d00b5d50 con 0x7f41d00afbd0 2024-04-27T02:38:45.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.443+0000 7f41d7200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f41d0142a80 con 0x7f41d014bf40 2024-04-27T02:38:45.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.443+0000 7f41d6800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41d014bf40 0x7f41d0153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:45.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.443+0000 7f41d6800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41d014bf40 0x7f41d0153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38842/0 (socket says 172.21.15.16:38842) 2024-04-27T02:38:45.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.443+0000 7f41d6800640 1 -- 172.21.15.16:0/1336732268 learned_addr learned my addr 172.21.15.16:0/1336732268 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:45.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.443+0000 7f41d5e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f41d00b6a90 0x7f41d00b3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47486/0 (socket says 172.21.15.16:47486) 2024-04-27T02:38:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.444+0000 7f41d6800640 1 -- 172.21.15.16:0/1336732268 >> v1:172.21.15.32:6789/0 conn(0x7f41d00afbd0 legacy=0x7f41d014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.444+0000 7f41d6800640 1 -- 172.21.15.16:0/1336732268 >> v1:172.21.15.16:6789/0 conn(0x7f41d00b6a90 legacy=0x7f41d00b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.444+0000 7f41d6800640 1 -- 172.21.15.16:0/1336732268 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d00b6030 con 0x7f41d014bf40 2024-04-27T02:38:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.444+0000 7f41d4a00640 1 -- 172.21.15.16:0/1336732268 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599521008 0 0) 0x7f41d00b6e70 con 0x7f41d00b6a90 2024-04-27T02:38:45.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.445+0000 7f41d6800640 1 --2- 172.21.15.16:0/1336732268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d014bf40 0x7f41d0153bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009e50 tx=0x7f41cc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ae17c75c8319f server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:45.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.445+0000 7f41d4a00640 1 -- 172.21.15.16:0/1336732268 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc036070 con 0x7f41d014bf40 2024-04-27T02:38:45.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.445+0000 7f41d4a00640 1 -- 172.21.15.16:0/1336732268 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc031600 con 0x7f41d014bf40 2024-04-27T02:38:45.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.445+0000 7f41d4a00640 1 -- 172.21.15.16:0/1336732268 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0319d0 con 0x7f41d014bf40 2024-04-27T02:38:45.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.446+0000 7f41d7200640 1 -- 172.21.15.16:0/1336732268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d014bf40 msgr2=0x7f41d0153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.446+0000 7f41d7200640 1 --2- 172.21.15.16:0/1336732268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d014bf40 0x7f41d0153bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009e50 tx=0x7f41cc02a6a0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.446+0000 7f41d7200640 1 -- 172.21.15.16:0/1336732268 shutdown_connections 2024-04-27T02:38:45.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.446+0000 7f41d7200640 1 --2- 172.21.15.16:0/1336732268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d014bf40 0x7f41d0153bb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.446+0000 7f41d7200640 1 -- 172.21.15.16:0/1336732268 >> 172.21.15.16:0/1336732268 conn(0x7f41d0068270 msgr2=0x7f41d0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:45.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.446+0000 7f41d7200640 1 -- 172.21.15.16:0/1336732268 shutdown_connections 2024-04-27T02:38:45.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.446+0000 7f41d7200640 1 -- 172.21.15.16:0/1336732268 wait complete. 2024-04-27T02:38:45.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.448+0000 7f41d7200640 1 Processor -- start 2024-04-27T02:38:45.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.448+0000 7f41d7200640 1 -- start start 2024-04-27T02:38:45.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d00afbd0 0x7f41d0148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:45.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d7200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41d00b6a90 0x7f41d00729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:45.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d7200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f41d014bf40 0x7f41d01dd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d7200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41d00b0b50 con 0x7f41d00afbd0 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d7200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f41d00b5b00 con 0x7f41d00b6a90 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d7200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f41d0073cb0 con 0x7f41d014bf40 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d00afbd0 0x7f41d0148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d00afbd0 0x7f41d0148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38856/0 (socket says 172.21.15.16:38856) 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 -- 172.21.15.16:0/1268206893 learned_addr learned my addr 172.21.15.16:0/1268206893 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 -- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f41d014bf40 msgr2=0x7f41d01dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d6800640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f41d014bf40 0x7f41d01dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:45.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5400640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41d00b6a90 0x7f41d00729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:45.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f41d014bf40 0x7f41d01dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 -- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41d00b6a90 msgr2=0x7f41d00729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41d00b6a90 0x7f41d00729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d5e00640 1 -- 172.21.15.16:0/1268206893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d0071f30 con 0x7f41d00afbd0 2024-04-27T02:38:45.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.449+0000 7f41d6800640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f41d014bf40 0x7f41d01dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:38:45.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.450+0000 7f41d5e00640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d00afbd0 0x7f41d0148c00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41c400c4a0 tx=0x7f41c400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:45.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.450+0000 7f41ca000640 1 -- 172.21.15.16:0/1268206893 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4018070 con 0x7f41d00afbd0 2024-04-27T02:38:45.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.450+0000 7f41ca000640 1 -- 172.21.15.16:0/1268206893 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c40074e0 con 0x7f41d00afbd0 2024-04-27T02:38:45.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.450+0000 7f41ca000640 1 -- 172.21.15.16:0/1268206893 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4004a20 con 0x7f41d00afbd0 2024-04-27T02:38:45.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.450+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d0072210 con 0x7f41d00afbd0 2024-04-27T02:38:45.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.450+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d01486e0 con 0x7f41d00afbd0 2024-04-27T02:38:45.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.451+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d01488e0 con 0x7f41d00afbd0 2024-04-27T02:38:45.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.452+0000 7f41ca000640 1 -- 172.21.15.16:0/1268206893 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41c4004bc0 con 0x7f41d00afbd0 2024-04-27T02:38:45.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.453+0000 7f41ca000640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f41b406c920 0x7f41b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:38:45.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.453+0000 7f41ca000640 1 -- 172.21.15.16:0/1268206893 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f41c408adc0 con 0x7f41d00afbd0 2024-04-27T02:38:45.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.454+0000 7f41d5400640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f41b406c920 0x7f41b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:38:45.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.455+0000 7f41d5400640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f41b406c920 0x7f41b406ede0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f41d014bd90 tx=0x7f41c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:38:45.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.458+0000 7f41ca000640 1 -- 172.21.15.16:0/1268206893 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f41d01488e0 con 0x7f41d00afbd0 2024-04-27T02:38:45.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.664+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41d0076600 con 0x7f41b406c920 2024-04-27T02:38:45.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.683+0000 7f41ca000640 1 -- 172.21.15.16:0/1268206893 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249609 (secure 0 0 0) 0x7f41d0076600 con 0x7f41b406c920 2024-04-27T02:38:45.660 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:38:45.661 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f41b406c920 msgr2=0x7f41b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f41b406c920 0x7f41b406ede0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f41d014bd90 tx=0x7f41c0009040 comp rx=0 tx=0).stop 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d00afbd0 msgr2=0x7f41d0148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d00afbd0 0x7f41d0148c00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41c400c4a0 tx=0x7f41c400c960 comp rx=0 tx=0).stop 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 shutdown_connections 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f41b406c920 0x7f41b406ede0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f41d00b6a90 0x7f41d00729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f41d014bf40 0x7f41d01dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 --2- 172.21.15.16:0/1268206893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d00afbd0 0x7f41d0148c00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:38:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 >> 172.21.15.16:0/1268206893 conn(0x7f41d0068270 msgr2=0x7f41d00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:38:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 shutdown_connections 2024-04-27T02:38:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:38:45.689+0000 7f41d7200640 1 -- 172.21.15.16:0/1268206893 wait complete. 2024-04-27T02:38:45.685 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":5536,"stamp":"2024-04-27T02:38:44.156175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":792815,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":147,"num_read_kb":130,"num_write":329,"num_write_kb":3713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252824,"kb_used_data":3416,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721896,"statfs":{"total":773094113280,"available":772835221504,"internally_reserved":0,"allocated":3497984,"data_stored":2248406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004206"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:43.870953+0000","last_change":"2024-04-26T23:35:33.823180+0000","last_active":"2024-04-27T02:34:43.870953+0000","last_peered":"2024-04-27T02:34:43.870953+0000","last_clean":"2024-04-27T02:34:43.870953+0000","last_became_active":"2024-04-26T23:35:33.822081+0000","last_became_peered":"2024-04-26T23:35:33.822081+0000","last_unstale":"2024-04-27T02:34:43.870953+0000","last_undegraded":"2024-04-27T02:34:43.870953+0000","last_fullsized":"2024-04-27T02:34:43.870953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:48:26.137989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.903599+0000","last_change":"2024-04-26T23:34:46.104624+0000","last_active":"2024-04-27T02:38:08.903599+0000","last_peered":"2024-04-27T02:38:08.903599+0000","last_clean":"2024-04-27T02:38:08.903599+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-27T02:38:08.903599+0000","last_undegraded":"2024-04-27T02:38:08.903599+0000","last_fullsized":"2024-04-27T02:38:08.903599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"22'1","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.903573+0000","last_change":"2024-04-26T23:34:46.108778+0000","last_active":"2024-04-27T02:38:08.903573+0000","last_peered":"2024-04-27T02:38:08.903573+0000","last_clean":"2024-04-27T02:38:08.903573+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-27T02:38:08.903573+0000","last_undegraded":"2024-04-27T02:38:08.903573+0000","last_fullsized":"2024-04-27T02:38:08.903573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.901443+0000","last_change":"2024-04-27T02:38:43.901510+0000","last_active":"2024-04-27T02:38:43.901443+0000","last_peered":"2024-04-27T02:38:43.901443+0000","last_clean":"2024-04-27T02:38:43.901443+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-27T02:38:43.901443+0000","last_undegraded":"2024-04-27T02:38:43.901443+0000","last_fullsized":"2024-04-27T02:38:43.901443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:43.901234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:43.901234+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.901234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:06:55.448623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.908093+0000","last_change":"2024-04-26T23:34:46.114691+0000","last_active":"2024-04-27T02:37:18.908093+0000","last_peered":"2024-04-27T02:37:18.908093+0000","last_clean":"2024-04-27T02:37:18.908093+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-27T02:37:18.908093+0000","last_undegraded":"2024-04-27T02:37:18.908093+0000","last_fullsized":"2024-04-27T02:37:18.908093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.903154+0000","last_change":"2024-04-26T23:34:46.103641+0000","last_active":"2024-04-27T02:37:18.903154+0000","last_peered":"2024-04-27T02:37:18.903154+0000","last_clean":"2024-04-27T02:37:18.903154+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-27T02:37:18.903154+0000","last_undegraded":"2024-04-27T02:37:18.903154+0000","last_fullsized":"2024-04-27T02:37:18.903154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.908054+0000","last_change":"2024-04-26T23:34:46.078253+0000","last_active":"2024-04-27T02:37:18.908054+0000","last_peered":"2024-04-27T02:37:18.908054+0000","last_clean":"2024-04-27T02:37:18.908054+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-27T02:37:18.908054+0000","last_undegraded":"2024-04-27T02:37:18.908054+0000","last_fullsized":"2024-04-27T02:37:18.908054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.894772+0000","last_change":"2024-04-26T23:34:46.120052+0000","last_active":"2024-04-27T02:37:18.894772+0000","last_peered":"2024-04-27T02:37:18.894772+0000","last_clean":"2024-04-27T02:37:18.894772+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-27T02:37:18.894772+0000","last_undegraded":"2024-04-27T02:37:18.894772+0000","last_fullsized":"2024-04-27T02:37:18.894772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:33.895274+0000","last_change":"2024-04-26T23:34:46.098756+0000","last_active":"2024-04-27T02:36:33.895274+0000","last_peered":"2024-04-27T02:36:33.895274+0000","last_clean":"2024-04-27T02:36:33.895274+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-27T02:36:33.895274+0000","last_undegraded":"2024-04-27T02:36:33.895274+0000","last_fullsized":"2024-04-27T02:36:33.895274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"22'3","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.920413+0000","last_change":"2024-04-26T23:34:46.108579+0000","last_active":"2024-04-27T02:38:28.920413+0000","last_peered":"2024-04-27T02:38:28.920413+0000","last_clean":"2024-04-27T02:38:28.920413+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-27T02:38:28.920413+0000","last_undegraded":"2024-04-27T02:38:28.920413+0000","last_fullsized":"2024-04-27T02:38:28.920413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.920369+0000","last_change":"2024-04-26T23:34:46.091413+0000","last_active":"2024-04-27T02:38:28.920369+0000","last_peered":"2024-04-27T02:38:28.920369+0000","last_clean":"2024-04-27T02:38:28.920369+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-27T02:38:28.920369+0000","last_undegraded":"2024-04-27T02:38:28.920369+0000","last_fullsized":"2024-04-27T02:38:28.920369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.920326+0000","last_change":"2024-04-26T23:34:46.098527+0000","last_active":"2024-04-27T02:38:28.920326+0000","last_peered":"2024-04-27T02:38:28.920326+0000","last_clean":"2024-04-27T02:38:28.920326+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-27T02:38:28.920326+0000","last_undegraded":"2024-04-27T02:38:28.920326+0000","last_fullsized":"2024-04-27T02:38:28.920326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886609+0000","last_change":"2024-04-26T23:34:46.101443+0000","last_active":"2024-04-27T02:36:03.886609+0000","last_peered":"2024-04-27T02:36:03.886609+0000","last_clean":"2024-04-27T02:36:03.886609+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-27T02:36:03.886609+0000","last_undegraded":"2024-04-27T02:36:03.886609+0000","last_fullsized":"2024-04-27T02:36:03.886609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:36.824792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:58.876176+0000","last_change":"2024-04-26T23:34:46.089795+0000","last_active":"2024-04-27T02:34:58.876176+0000","last_peered":"2024-04-27T02:34:58.876176+0000","last_clean":"2024-04-27T02:34:58.876176+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-27T02:34:58.876176+0000","last_undegraded":"2024-04-27T02:34:58.876176+0000","last_fullsized":"2024-04-27T02:34:58.876176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:22.738276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.889534+0000","last_change":"2024-04-26T23:34:46.099479+0000","last_active":"2024-04-27T02:36:48.889534+0000","last_peered":"2024-04-27T02:36:48.889534+0000","last_clean":"2024-04-27T02:36:48.889534+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-27T02:36:48.889534+0000","last_undegraded":"2024-04-27T02:36:48.889534+0000","last_fullsized":"2024-04-27T02:36:48.889534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"22'1","reported_seq":96,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.903977+0000","last_change":"2024-04-26T23:34:46.102955+0000","last_active":"2024-04-27T02:36:48.903977+0000","last_peered":"2024-04-27T02:36:48.903977+0000","last_clean":"2024-04-27T02:36:48.903977+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-27T02:36:48.903977+0000","last_undegraded":"2024-04-27T02:36:48.903977+0000","last_fullsized":"2024-04-27T02:36:48.903977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.904184+0000","last_change":"2024-04-26T23:34:46.095012+0000","last_active":"2024-04-27T02:36:48.904184+0000","last_peered":"2024-04-27T02:36:48.904184+0000","last_clean":"2024-04-27T02:36:48.904184+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-27T02:36:48.904184+0000","last_undegraded":"2024-04-27T02:36:48.904184+0000","last_fullsized":"2024-04-27T02:36:48.904184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158366+0000","last_change":"2024-04-26T23:34:46.109530+0000","last_active":"2024-04-27T02:34:29.158366+0000","last_peered":"2024-04-27T02:34:29.158366+0000","last_clean":"2024-04-27T02:34:29.158366+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-27T02:34:29.158366+0000","last_undegraded":"2024-04-27T02:34:29.158366+0000","last_fullsized":"2024-04-27T02:34:29.158366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:30:06.179079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:33.911619+0000","last_change":"2024-04-26T23:34:46.091860+0000","last_active":"2024-04-27T02:37:33.911619+0000","last_peered":"2024-04-27T02:37:33.911619+0000","last_clean":"2024-04-27T02:37:33.911619+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-27T02:37:33.911619+0000","last_undegraded":"2024-04-27T02:37:33.911619+0000","last_fullsized":"2024-04-27T02:37:33.911619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"22'1","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.905531+0000","last_change":"2024-04-26T23:34:46.095475+0000","last_active":"2024-04-27T02:37:03.905531+0000","last_peered":"2024-04-27T02:37:03.905531+0000","last_clean":"2024-04-27T02:37:03.905531+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-27T02:37:03.905531+0000","last_undegraded":"2024-04-27T02:37:03.905531+0000","last_fullsized":"2024-04-27T02:37:03.905531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"22'3","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.899406+0000","last_change":"2024-04-26T23:34:46.105787+0000","last_active":"2024-04-27T02:37:03.899406+0000","last_peered":"2024-04-27T02:37:03.899406+0000","last_clean":"2024-04-27T02:37:03.899406+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-27T02:37:03.899406+0000","last_undegraded":"2024-04-27T02:37:03.899406+0000","last_fullsized":"2024-04-27T02:37:03.899406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"22'1","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.022492+0000","last_change":"2024-04-27T02:38:43.022536+0000","last_active":"2024-04-27T02:38:43.022492+0000","last_peered":"2024-04-27T02:38:43.022492+0000","last_clean":"2024-04-27T02:38:43.022492+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-27T02:38:43.022492+0000","last_undegraded":"2024-04-27T02:38:43.022492+0000","last_fullsized":"2024-04-27T02:38:43.022492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:43.022372+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:43.022372+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.022372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:23.160083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.892103+0000","last_change":"2024-04-26T23:34:46.108790+0000","last_active":"2024-04-27T02:37:03.892103+0000","last_peered":"2024-04-27T02:37:03.892103+0000","last_clean":"2024-04-27T02:37:03.892103+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-27T02:37:03.892103+0000","last_undegraded":"2024-04-27T02:37:03.892103+0000","last_fullsized":"2024-04-27T02:37:03.892103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"22'5","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.909059+0000","last_change":"2024-04-26T23:34:46.119916+0000","last_active":"2024-04-27T02:37:18.909059+0000","last_peered":"2024-04-27T02:37:18.909059+0000","last_clean":"2024-04-27T02:37:18.909059+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-27T02:37:18.909059+0000","last_undegraded":"2024-04-27T02:37:18.909059+0000","last_fullsized":"2024-04-27T02:37:18.909059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.889600+0000","last_change":"2024-04-26T23:34:46.109777+0000","last_active":"2024-04-27T02:36:48.889600+0000","last_peered":"2024-04-27T02:36:48.889600+0000","last_clean":"2024-04-27T02:36:48.889600+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-27T02:36:48.889600+0000","last_undegraded":"2024-04-27T02:36:48.889600+0000","last_fullsized":"2024-04-27T02:36:48.889600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.898451+0000","last_change":"2024-04-26T23:34:46.105882+0000","last_active":"2024-04-27T02:36:48.898451+0000","last_peered":"2024-04-27T02:36:48.898451+0000","last_clean":"2024-04-27T02:36:48.898451+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-27T02:36:48.898451+0000","last_undegraded":"2024-04-27T02:36:48.898451+0000","last_fullsized":"2024-04-27T02:36:48.898451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873079+0000","last_change":"2024-04-26T23:34:46.096140+0000","last_active":"2024-04-27T02:34:38.873079+0000","last_peered":"2024-04-27T02:34:38.873079+0000","last_clean":"2024-04-27T02:34:38.873079+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-27T02:34:38.873079+0000","last_undegraded":"2024-04-27T02:34:38.873079+0000","last_fullsized":"2024-04-27T02:34:38.873079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:38.008259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:38.873013+0000","last_change":"2024-04-26T23:34:46.095966+0000","last_active":"2024-04-27T02:34:38.873013+0000","last_peered":"2024-04-27T02:34:38.873013+0000","last_clean":"2024-04-27T02:34:38.873013+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-27T02:34:38.873013+0000","last_undegraded":"2024-04-27T02:34:38.873013+0000","last_fullsized":"2024-04-27T02:34:38.873013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.702209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:38.908553+0000","last_change":"2024-04-26T23:34:46.107441+0000","last_active":"2024-04-27T02:38:38.908553+0000","last_peered":"2024-04-27T02:38:38.908553+0000","last_clean":"2024-04-27T02:38:38.908553+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-27T02:38:38.908553+0000","last_undegraded":"2024-04-27T02:38:38.908553+0000","last_fullsized":"2024-04-27T02:38:38.908553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.917772+0000","last_change":"2024-04-26T23:34:46.105829+0000","last_active":"2024-04-27T02:38:08.917772+0000","last_peered":"2024-04-27T02:38:08.917772+0000","last_clean":"2024-04-27T02:38:08.917772+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-27T02:38:08.917772+0000","last_undegraded":"2024-04-27T02:38:08.917772+0000","last_fullsized":"2024-04-27T02:38:08.917772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882856+0000","last_change":"2024-04-26T23:34:46.090849+0000","last_active":"2024-04-27T02:36:03.882856+0000","last_peered":"2024-04-27T02:36:03.882856+0000","last_clean":"2024-04-27T02:36:03.882856+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-27T02:36:03.882856+0000","last_undegraded":"2024-04-27T02:36:03.882856+0000","last_fullsized":"2024-04-27T02:36:03.882856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:11.352424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.925236+0000","last_change":"2024-04-27T02:38:42.925288+0000","last_active":"2024-04-27T02:38:42.925236+0000","last_peered":"2024-04-27T02:38:42.925236+0000","last_clean":"2024-04-27T02:38:42.925236+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-27T02:38:42.925236+0000","last_undegraded":"2024-04-27T02:38:42.925236+0000","last_fullsized":"2024-04-27T02:38:42.925236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:42.924973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:42.924973+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.924973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:23.062684+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.902467+0000","last_change":"2024-04-26T23:34:46.115333+0000","last_active":"2024-04-27T02:37:18.902467+0000","last_peered":"2024-04-27T02:37:18.902467+0000","last_clean":"2024-04-27T02:37:18.902467+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-27T02:37:18.902467+0000","last_undegraded":"2024-04-27T02:37:18.902467+0000","last_fullsized":"2024-04-27T02:37:18.902467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.894910+0000","last_change":"2024-04-26T23:34:45.083366+0000","last_active":"2024-04-27T02:37:18.894910+0000","last_peered":"2024-04-27T02:37:18.894910+0000","last_clean":"2024-04-27T02:37:18.894910+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-27T02:37:18.894910+0000","last_undegraded":"2024-04-27T02:37:18.894910+0000","last_fullsized":"2024-04-27T02:37:18.894910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.901876+0000","last_change":"2024-04-26T23:34:46.085712+0000","last_active":"2024-04-27T02:37:18.901876+0000","last_peered":"2024-04-27T02:37:18.901876+0000","last_clean":"2024-04-27T02:37:18.901876+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-27T02:37:18.901876+0000","last_undegraded":"2024-04-27T02:37:18.901876+0000","last_fullsized":"2024-04-27T02:37:18.901876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.909195+0000","last_change":"2024-04-26T23:34:45.085842+0000","last_active":"2024-04-27T02:37:18.909195+0000","last_peered":"2024-04-27T02:37:18.909195+0000","last_clean":"2024-04-27T02:37:18.909195+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-27T02:37:18.909195+0000","last_undegraded":"2024-04-27T02:37:18.909195+0000","last_fullsized":"2024-04-27T02:37:18.909195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:04.166242+0000","last_change":"2024-04-26T23:34:45.081971+0000","last_active":"2024-04-27T02:34:04.166242+0000","last_peered":"2024-04-27T02:34:04.166242+0000","last_clean":"2024-04-27T02:34:04.166242+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-27T02:34:04.166242+0000","last_undegraded":"2024-04-27T02:34:04.166242+0000","last_fullsized":"2024-04-27T02:34:04.166242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.906905+0000","last_change":"2024-04-26T23:34:46.099460+0000","last_active":"2024-04-27T02:38:28.906905+0000","last_peered":"2024-04-27T02:38:28.906905+0000","last_clean":"2024-04-27T02:38:28.906905+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-27T02:38:28.906905+0000","last_undegraded":"2024-04-27T02:38:28.906905+0000","last_fullsized":"2024-04-27T02:38:28.906905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.921325+0000","last_change":"2024-04-26T23:34:45.072957+0000","last_active":"2024-04-27T02:38:28.921325+0000","last_peered":"2024-04-27T02:38:28.921325+0000","last_clean":"2024-04-27T02:38:28.921325+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-27T02:38:28.921325+0000","last_undegraded":"2024-04-27T02:38:28.921325+0000","last_fullsized":"2024-04-27T02:38:28.921325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:33.894438+0000","last_change":"2024-04-26T23:34:46.093268+0000","last_active":"2024-04-27T02:36:33.894438+0000","last_peered":"2024-04-27T02:36:33.894438+0000","last_clean":"2024-04-27T02:36:33.894438+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-27T02:36:33.894438+0000","last_undegraded":"2024-04-27T02:36:33.894438+0000","last_fullsized":"2024-04-27T02:36:33.894438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.031844+0000","last_change":"2024-04-27T02:38:42.031905+0000","last_active":"2024-04-27T02:38:42.031844+0000","last_peered":"2024-04-27T02:38:42.031844+0000","last_clean":"2024-04-27T02:38:42.031844+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-27T02:38:42.031844+0000","last_undegraded":"2024-04-27T02:38:42.031844+0000","last_fullsized":"2024-04-27T02:38:42.031844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:42.031622+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:42.031622+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.031622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:17.717674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.914636+0000","last_change":"2024-04-26T23:34:46.106328+0000","last_active":"2024-04-27T02:38:28.914636+0000","last_peered":"2024-04-27T02:38:28.914636+0000","last_clean":"2024-04-27T02:38:28.914636+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-27T02:38:28.914636+0000","last_undegraded":"2024-04-27T02:38:28.914636+0000","last_fullsized":"2024-04-27T02:38:28.914636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:40.695830+0000","last_change":"2024-04-27T02:38:40.695889+0000","last_active":"2024-04-27T02:38:40.695830+0000","last_peered":"2024-04-27T02:38:40.695830+0000","last_clean":"2024-04-27T02:38:40.695830+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-27T02:38:40.695830+0000","last_undegraded":"2024-04-27T02:38:40.695830+0000","last_fullsized":"2024-04-27T02:38:40.695830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:40.695623+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:40.695623+0000","last_clean_scrub_stamp":"2024-04-27T02:38:40.695623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:58.686030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.906981+0000","last_change":"2024-04-26T23:34:46.119960+0000","last_active":"2024-04-27T02:38:28.906981+0000","last_peered":"2024-04-27T02:38:28.906981+0000","last_clean":"2024-04-27T02:38:28.906981+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-27T02:38:28.906981+0000","last_undegraded":"2024-04-27T02:38:28.906981+0000","last_fullsized":"2024-04-27T02:38:28.906981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882929+0000","last_change":"2024-04-26T23:34:45.077215+0000","last_active":"2024-04-27T02:36:03.882929+0000","last_peered":"2024-04-27T02:36:03.882929+0000","last_clean":"2024-04-27T02:36:03.882929+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-27T02:36:03.882929+0000","last_undegraded":"2024-04-27T02:36:03.882929+0000","last_fullsized":"2024-04-27T02:36:03.882929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.909229+0000","last_change":"2024-04-26T23:34:46.107497+0000","last_active":"2024-04-27T02:37:18.909229+0000","last_peered":"2024-04-27T02:37:18.909229+0000","last_clean":"2024-04-27T02:37:18.909229+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-27T02:37:18.909229+0000","last_undegraded":"2024-04-27T02:37:18.909229+0000","last_fullsized":"2024-04-27T02:37:18.909229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'59","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:41.941442+0000","last_change":"2024-04-27T02:38:41.941491+0000","last_active":"2024-04-27T02:38:41.941442+0000","last_peered":"2024-04-27T02:38:41.941442+0000","last_clean":"2024-04-27T02:38:41.941442+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-27T02:38:41.941442+0000","last_undegraded":"2024-04-27T02:38:41.941442+0000","last_fullsized":"2024-04-27T02:38:41.941442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-04-27T02:38:41.941294+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-04-27T02:38:41.941294+0000","last_clean_scrub_stamp":"2024-04-27T02:38:41.941294+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:17.627346+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199217,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":93,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:28.920393+0000","last_change":"2024-04-26T23:34:46.098821+0000","last_active":"2024-04-27T02:38:28.920393+0000","last_peered":"2024-04-27T02:38:28.920393+0000","last_clean":"2024-04-27T02:38:28.920393+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-27T02:38:28.920393+0000","last_undegraded":"2024-04-27T02:38:28.920393+0000","last_fullsized":"2024-04-27T02:38:28.920393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'3","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.158273+0000","last_change":"2024-04-26T23:34:45.083289+0000","last_active":"2024-04-27T02:34:29.158273+0000","last_peered":"2024-04-27T02:34:29.158273+0000","last_clean":"2024-04-27T02:34:29.158273+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-27T02:34:29.158273+0000","last_undegraded":"2024-04-27T02:34:29.158273+0000","last_fullsized":"2024-04-27T02:34:29.158273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:57.784880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":94,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:29.170403+0000","last_change":"2024-04-26T23:34:46.107707+0000","last_active":"2024-04-27T02:34:29.170403+0000","last_peered":"2024-04-27T02:34:29.170403+0000","last_clean":"2024-04-27T02:34:29.170403+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-27T02:34:29.170403+0000","last_undegraded":"2024-04-27T02:34:29.170403+0000","last_fullsized":"2024-04-27T02:34:29.170403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:24.744187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.904088+0000","last_change":"2024-04-26T23:34:45.081285+0000","last_active":"2024-04-27T02:36:48.904088+0000","last_peered":"2024-04-27T02:36:48.904088+0000","last_clean":"2024-04-27T02:36:48.904088+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-27T02:36:48.904088+0000","last_undegraded":"2024-04-27T02:36:48.904088+0000","last_fullsized":"2024-04-27T02:36:48.904088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.721273+0000","last_change":"2024-04-27T02:38:43.721326+0000","last_active":"2024-04-27T02:38:43.721273+0000","last_peered":"2024-04-27T02:38:43.721273+0000","last_clean":"2024-04-27T02:38:43.721273+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-27T02:38:43.721273+0000","last_undegraded":"2024-04-27T02:38:43.721273+0000","last_fullsized":"2024-04-27T02:38:43.721273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:43.720987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:43.720987+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.720987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:35.301346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.902991+0000","last_change":"2024-04-26T23:34:45.087258+0000","last_active":"2024-04-27T02:36:48.902991+0000","last_peered":"2024-04-27T02:36:48.902991+0000","last_clean":"2024-04-27T02:36:48.902991+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-27T02:36:48.902991+0000","last_undegraded":"2024-04-27T02:36:48.902991+0000","last_fullsized":"2024-04-27T02:36:48.902991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.897559+0000","last_change":"2024-04-26T23:34:46.119613+0000","last_active":"2024-04-27T02:36:48.897559+0000","last_peered":"2024-04-27T02:36:48.897559+0000","last_clean":"2024-04-27T02:36:48.897559+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-27T02:36:48.897559+0000","last_undegraded":"2024-04-27T02:36:48.897559+0000","last_fullsized":"2024-04-27T02:36:48.897559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'13","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.858016+0000","last_change":"2024-04-27T02:38:43.858109+0000","last_active":"2024-04-27T02:38:43.858016+0000","last_peered":"2024-04-27T02:38:43.858016+0000","last_clean":"2024-04-27T02:38:43.858016+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-27T02:38:43.858016+0000","last_undegraded":"2024-04-27T02:38:43.858016+0000","last_fullsized":"2024-04-27T02:38:43.858016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2024-04-27T02:38:43.857799+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2024-04-27T02:38:43.857799+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.857799+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:13:42.338064+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.904025+0000","last_change":"2024-04-26T23:34:46.107410+0000","last_active":"2024-04-27T02:36:48.904025+0000","last_peered":"2024-04-27T02:36:48.904025+0000","last_clean":"2024-04-27T02:36:48.904025+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-27T02:36:48.904025+0000","last_undegraded":"2024-04-27T02:36:48.904025+0000","last_fullsized":"2024-04-27T02:36:48.904025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:33.910802+0000","last_change":"2024-04-26T23:34:45.085124+0000","last_active":"2024-04-27T02:37:33.910802+0000","last_peered":"2024-04-27T02:37:33.910802+0000","last_clean":"2024-04-27T02:37:33.910802+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-27T02:37:33.910802+0000","last_undegraded":"2024-04-27T02:37:33.910802+0000","last_fullsized":"2024-04-27T02:37:33.910802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.900734+0000","last_change":"2024-04-26T23:34:46.107631+0000","last_active":"2024-04-27T02:37:03.900734+0000","last_peered":"2024-04-27T02:37:03.900734+0000","last_clean":"2024-04-27T02:37:03.900734+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-27T02:37:03.900734+0000","last_undegraded":"2024-04-27T02:37:03.900734+0000","last_fullsized":"2024-04-27T02:37:03.900734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.899485+0000","last_change":"2024-04-26T23:34:45.075990+0000","last_active":"2024-04-27T02:37:03.899485+0000","last_peered":"2024-04-27T02:37:03.899485+0000","last_clean":"2024-04-27T02:37:03.899485+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-27T02:37:03.899485+0000","last_undegraded":"2024-04-27T02:37:03.899485+0000","last_fullsized":"2024-04-27T02:37:03.899485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:33.910762+0000","last_change":"2024-04-26T23:34:46.099647+0000","last_active":"2024-04-27T02:37:33.910762+0000","last_peered":"2024-04-27T02:37:33.910762+0000","last_clean":"2024-04-27T02:37:33.910762+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-27T02:37:33.910762+0000","last_undegraded":"2024-04-27T02:37:33.910762+0000","last_fullsized":"2024-04-27T02:37:33.910762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.892187+0000","last_change":"2024-04-26T23:34:45.073426+0000","last_active":"2024-04-27T02:37:03.892187+0000","last_peered":"2024-04-27T02:37:03.892187+0000","last_clean":"2024-04-27T02:37:03.892187+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-27T02:37:03.892187+0000","last_undegraded":"2024-04-27T02:37:03.892187+0000","last_fullsized":"2024-04-27T02:37:03.892187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.905598+0000","last_change":"2024-04-26T23:34:46.082586+0000","last_active":"2024-04-27T02:37:03.905598+0000","last_peered":"2024-04-27T02:37:03.905598+0000","last_clean":"2024-04-27T02:37:03.905598+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-27T02:37:03.905598+0000","last_undegraded":"2024-04-27T02:37:03.905598+0000","last_fullsized":"2024-04-27T02:37:03.905598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":100,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.874659+0000","last_change":"2024-04-26T23:34:45.082463+0000","last_active":"2024-04-27T02:34:48.874659+0000","last_peered":"2024-04-27T02:34:48.874659+0000","last_clean":"2024-04-27T02:34:48.874659+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-27T02:34:48.874659+0000","last_undegraded":"2024-04-27T02:34:48.874659+0000","last_fullsized":"2024-04-27T02:34:48.874659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:37.807843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.906717+0000","last_change":"2024-04-26T23:34:46.097981+0000","last_active":"2024-04-27T02:37:03.906717+0000","last_peered":"2024-04-27T02:37:03.906717+0000","last_clean":"2024-04-27T02:37:03.906717+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-27T02:37:03.906717+0000","last_undegraded":"2024-04-27T02:37:03.906717+0000","last_fullsized":"2024-04-27T02:37:03.906717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'163","reported_seq":329,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:41.064822+0000","last_change":"2024-04-27T02:38:41.064854+0000","last_active":"2024-04-27T02:38:41.064822+0000","last_peered":"2024-04-27T02:38:41.064822+0000","last_clean":"2024-04-27T02:38:41.064822+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-27T02:38:41.064822+0000","last_undegraded":"2024-04-27T02:38:41.064822+0000","last_fullsized":"2024-04-27T02:38:41.064822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'163","last_scrub_stamp":"2024-04-27T02:38:41.064749+0000","last_deep_scrub":"22'163","last_deep_scrub_stamp":"2024-04-27T02:38:41.064749+0000","last_clean_scrub_stamp":"2024-04-27T02:38:41.064749+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:34.829414+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.917845+0000","last_change":"2024-04-26T23:34:45.074550+0000","last_active":"2024-04-27T02:38:08.917845+0000","last_peered":"2024-04-27T02:38:08.917845+0000","last_clean":"2024-04-27T02:38:08.917845+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-27T02:38:08.917845+0000","last_undegraded":"2024-04-27T02:38:08.917845+0000","last_fullsized":"2024-04-27T02:38:08.917845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.909847+0000","last_change":"2024-04-26T23:34:46.106060+0000","last_active":"2024-04-27T02:38:08.909847+0000","last_peered":"2024-04-27T02:38:08.909847+0000","last_clean":"2024-04-27T02:38:08.909847+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-27T02:38:08.909847+0000","last_undegraded":"2024-04-27T02:38:08.909847+0000","last_fullsized":"2024-04-27T02:38:08.909847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.909097+0000","last_change":"2024-04-26T23:34:45.078340+0000","last_active":"2024-04-27T02:37:18.909097+0000","last_peered":"2024-04-27T02:37:18.909097+0000","last_clean":"2024-04-27T02:37:18.909097+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-27T02:37:18.909097+0000","last_undegraded":"2024-04-27T02:37:18.909097+0000","last_fullsized":"2024-04-27T02:37:18.909097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886561+0000","last_change":"2024-04-26T23:34:46.110649+0000","last_active":"2024-04-27T02:36:03.886561+0000","last_peered":"2024-04-27T02:36:03.886561+0000","last_clean":"2024-04-27T02:36:03.886561+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-27T02:36:03.886561+0000","last_undegraded":"2024-04-27T02:36:03.886561+0000","last_fullsized":"2024-04-27T02:36:03.886561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:36.716989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.882893+0000","last_change":"2024-04-26T23:34:45.080152+0000","last_active":"2024-04-27T02:36:03.882893+0000","last_peered":"2024-04-27T02:36:03.882893+0000","last_clean":"2024-04-27T02:36:03.882893+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-27T02:36:03.882893+0000","last_undegraded":"2024-04-27T02:36:03.882893+0000","last_fullsized":"2024-04-27T02:36:03.882893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:03.263854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":1,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"22'2","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.894827+0000","last_change":"2024-04-26T23:34:46.105118+0000","last_active":"2024-04-27T02:37:18.894827+0000","last_peered":"2024-04-27T02:37:18.894827+0000","last_clean":"2024-04-27T02:37:18.894827+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-27T02:37:18.894827+0000","last_undegraded":"2024-04-27T02:37:18.894827+0000","last_fullsized":"2024-04-27T02:37:18.894827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.917815+0000","last_change":"2024-04-26T23:34:45.081079+0000","last_active":"2024-04-27T02:38:08.917815+0000","last_peered":"2024-04-27T02:38:08.917815+0000","last_clean":"2024-04-27T02:38:08.917815+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-27T02:38:08.917815+0000","last_undegraded":"2024-04-27T02:38:08.917815+0000","last_fullsized":"2024-04-27T02:38:08.917815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.916996+0000","last_change":"2024-04-26T23:34:46.109334+0000","last_active":"2024-04-27T02:38:08.916996+0000","last_peered":"2024-04-27T02:38:08.916996+0000","last_clean":"2024-04-27T02:38:08.916996+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-27T02:38:08.916996+0000","last_undegraded":"2024-04-27T02:38:08.916996+0000","last_fullsized":"2024-04-27T02:38:08.916996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.903529+0000","last_change":"2024-04-26T23:34:45.084238+0000","last_active":"2024-04-27T02:38:08.903529+0000","last_peered":"2024-04-27T02:38:08.903529+0000","last_clean":"2024-04-27T02:38:08.903529+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-27T02:38:08.903529+0000","last_undegraded":"2024-04-27T02:38:08.903529+0000","last_fullsized":"2024-04-27T02:38:08.903529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'3","reported_seq":108,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:38.916103+0000","last_change":"2024-04-26T23:34:46.103380+0000","last_active":"2024-04-27T02:38:38.916103+0000","last_peered":"2024-04-27T02:38:38.916103+0000","last_clean":"2024-04-27T02:38:38.916103+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-27T02:38:38.916103+0000","last_undegraded":"2024-04-27T02:38:38.916103+0000","last_fullsized":"2024-04-27T02:38:38.916103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:38.922918+0000","last_change":"2024-04-26T23:34:45.085407+0000","last_active":"2024-04-27T02:38:38.922918+0000","last_peered":"2024-04-27T02:38:38.922918+0000","last_clean":"2024-04-27T02:38:38.922918+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-27T02:38:38.922918+0000","last_undegraded":"2024-04-27T02:38:38.922918+0000","last_fullsized":"2024-04-27T02:38:38.922918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:03.886639+0000","last_change":"2024-04-26T23:34:46.114522+0000","last_active":"2024-04-27T02:36:03.886639+0000","last_peered":"2024-04-27T02:36:03.886639+0000","last_clean":"2024-04-27T02:36:03.886639+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-27T02:36:03.886639+0000","last_undegraded":"2024-04-27T02:36:03.886639+0000","last_fullsized":"2024-04-27T02:36:03.886639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:34.834060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'5","reported_seq":108,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.896984+0000","last_change":"2024-04-26T23:34:45.081178+0000","last_active":"2024-04-27T02:36:48.896984+0000","last_peered":"2024-04-27T02:36:48.896984+0000","last_clean":"2024-04-27T02:36:48.896984+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-27T02:36:48.896984+0000","last_undegraded":"2024-04-27T02:36:48.896984+0000","last_fullsized":"2024-04-27T02:36:48.896984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'4","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.897003+0000","last_change":"2024-04-26T23:34:46.097242+0000","last_active":"2024-04-27T02:36:48.897003+0000","last_peered":"2024-04-27T02:36:48.897003+0000","last_clean":"2024-04-27T02:36:48.897003+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-27T02:36:48.897003+0000","last_undegraded":"2024-04-27T02:36:48.897003+0000","last_fullsized":"2024-04-27T02:36:48.897003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'3","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.904216+0000","last_change":"2024-04-26T23:34:45.078759+0000","last_active":"2024-04-27T02:36:48.904216+0000","last_peered":"2024-04-27T02:36:48.904216+0000","last_clean":"2024-04-27T02:36:48.904216+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-27T02:36:48.904216+0000","last_undegraded":"2024-04-27T02:36:48.904216+0000","last_fullsized":"2024-04-27T02:36:48.904216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.896952+0000","last_change":"2024-04-26T23:34:46.079931+0000","last_active":"2024-04-27T02:36:48.896952+0000","last_peered":"2024-04-27T02:36:48.896952+0000","last_clean":"2024-04-27T02:36:48.896952+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-27T02:36:48.896952+0000","last_undegraded":"2024-04-27T02:36:48.896952+0000","last_fullsized":"2024-04-27T02:36:48.896952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.691886+0000","last_change":"2024-04-27T02:38:43.691949+0000","last_active":"2024-04-27T02:38:43.691886+0000","last_peered":"2024-04-27T02:38:43.691886+0000","last_clean":"2024-04-27T02:38:43.691886+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-27T02:38:43.691886+0000","last_undegraded":"2024-04-27T02:38:43.691886+0000","last_fullsized":"2024-04-27T02:38:43.691886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:43.691686+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:43.691686+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.691686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:49.582144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.680437+0000","last_change":"2024-04-27T02:38:42.680458+0000","last_active":"2024-04-27T02:38:42.680437+0000","last_peered":"2024-04-27T02:38:42.680437+0000","last_clean":"2024-04-27T02:38:42.680437+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-27T02:38:42.680437+0000","last_undegraded":"2024-04-27T02:38:42.680437+0000","last_fullsized":"2024-04-27T02:38:42.680437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:42.680346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:42.680346+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.680346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:48.570804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.896922+0000","last_change":"2024-04-26T23:34:45.079808+0000","last_active":"2024-04-27T02:36:48.896922+0000","last_peered":"2024-04-27T02:36:48.896922+0000","last_clean":"2024-04-27T02:36:48.896922+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-27T02:36:48.896922+0000","last_undegraded":"2024-04-27T02:36:48.896922+0000","last_fullsized":"2024-04-27T02:36:48.896922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:36:48.896859+0000","last_change":"2024-04-26T23:34:46.084019+0000","last_active":"2024-04-27T02:36:48.896859+0000","last_peered":"2024-04-27T02:36:48.896859+0000","last_clean":"2024-04-27T02:36:48.896859+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-27T02:36:48.896859+0000","last_undegraded":"2024-04-27T02:36:48.896859+0000","last_fullsized":"2024-04-27T02:36:48.896859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:35:08.877678+0000","last_change":"2024-04-26T23:34:45.079576+0000","last_active":"2024-04-27T02:35:08.877678+0000","last_peered":"2024-04-27T02:35:08.877678+0000","last_clean":"2024-04-27T02:35:08.877678+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-27T02:35:08.877678+0000","last_undegraded":"2024-04-27T02:35:08.877678+0000","last_fullsized":"2024-04-27T02:35:08.877678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:11.181513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":97,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:34:48.871792+0000","last_change":"2024-04-26T23:34:46.100331+0000","last_active":"2024-04-27T02:34:48.871792+0000","last_peered":"2024-04-27T02:34:48.871792+0000","last_clean":"2024-04-27T02:34:48.871792+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-27T02:34:48.871792+0000","last_undegraded":"2024-04-27T02:34:48.871792+0000","last_fullsized":"2024-04-27T02:34:48.871792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:45.851876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:03.906634+0000","last_change":"2024-04-26T23:34:45.077087+0000","last_active":"2024-04-27T02:37:03.906634+0000","last_peered":"2024-04-27T02:37:03.906634+0000","last_clean":"2024-04-27T02:37:03.906634+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-27T02:37:03.906634+0000","last_undegraded":"2024-04-27T02:37:03.906634+0000","last_fullsized":"2024-04-27T02:37:03.906634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.909170+0000","last_change":"2024-04-26T23:34:46.096981+0000","last_active":"2024-04-27T02:37:18.909170+0000","last_peered":"2024-04-27T02:37:18.909170+0000","last_clean":"2024-04-27T02:37:18.909170+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-27T02:37:18.909170+0000","last_undegraded":"2024-04-27T02:37:18.909170+0000","last_fullsized":"2024-04-27T02:37:18.909170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.909246+0000","last_change":"2024-04-26T23:34:46.098865+0000","last_active":"2024-04-27T02:37:18.909246+0000","last_peered":"2024-04-27T02:37:18.909246+0000","last_clean":"2024-04-27T02:37:18.909246+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-27T02:37:18.909246+0000","last_undegraded":"2024-04-27T02:37:18.909246+0000","last_fullsized":"2024-04-27T02:37:18.909246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.733151+0000","last_change":"2024-04-27T02:38:42.733199+0000","last_active":"2024-04-27T02:38:42.733151+0000","last_peered":"2024-04-27T02:38:42.733151+0000","last_clean":"2024-04-27T02:38:42.733151+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-27T02:38:42.733151+0000","last_undegraded":"2024-04-27T02:38:42.733151+0000","last_fullsized":"2024-04-27T02:38:42.733151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-27T02:38:42.733007+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-27T02:38:42.733007+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.733007+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:43:25.471437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.902501+0000","last_change":"2024-04-26T23:34:46.101840+0000","last_active":"2024-04-27T02:37:18.902501+0000","last_peered":"2024-04-27T02:37:18.902501+0000","last_clean":"2024-04-27T02:37:18.902501+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-27T02:37:18.902501+0000","last_undegraded":"2024-04-27T02:37:18.902501+0000","last_fullsized":"2024-04-27T02:37:18.902501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:41.706415+0000","last_change":"2024-04-27T02:38:41.706468+0000","last_active":"2024-04-27T02:38:41.706415+0000","last_peered":"2024-04-27T02:38:41.706415+0000","last_clean":"2024-04-27T02:38:41.706415+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-27T02:38:41.706415+0000","last_undegraded":"2024-04-27T02:38:41.706415+0000","last_fullsized":"2024-04-27T02:38:41.706415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-27T02:38:41.706259+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-27T02:38:41.706259+0000","last_clean_scrub_stamp":"2024-04-27T02:38:41.706259+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:03:56.898237+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.903626+0000","last_change":"2024-04-26T23:34:46.109532+0000","last_active":"2024-04-27T02:38:08.903626+0000","last_peered":"2024-04-27T02:38:08.903626+0000","last_clean":"2024-04-27T02:38:08.903626+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-27T02:38:08.903626+0000","last_undegraded":"2024-04-27T02:38:08.903626+0000","last_fullsized":"2024-04-27T02:38:08.903626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.895010+0000","last_change":"2024-04-26T23:34:45.081893+0000","last_active":"2024-04-27T02:37:18.895010+0000","last_peered":"2024-04-27T02:37:18.895010+0000","last_clean":"2024-04-27T02:37:18.895010+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-27T02:37:18.895010+0000","last_undegraded":"2024-04-27T02:37:18.895010+0000","last_fullsized":"2024-04-27T02:37:18.895010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":108,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:37:18.894977+0000","last_change":"2024-04-26T23:34:46.103860+0000","last_active":"2024-04-27T02:37:18.894977+0000","last_peered":"2024-04-27T02:37:18.894977+0000","last_clean":"2024-04-27T02:37:18.894977+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-27T02:37:18.894977+0000","last_undegraded":"2024-04-27T02:37:18.894977+0000","last_fullsized":"2024-04-27T02:37:18.894977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:45.032056+0000","last_clean_scrub_stamp":"2024-04-26T23:34:45.032056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'5","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:08.909899+0000","last_change":"2024-04-26T23:34:45.083474+0000","last_active":"2024-04-27T02:38:08.909899+0000","last_peered":"2024-04-27T02:38:08.909899+0000","last_clean":"2024-04-27T02:38:08.909899+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-27T02:38:08.909899+0000","last_undegraded":"2024-04-27T02:38:08.909899+0000","last_fullsized":"2024-04-27T02:38:08.909899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:34:44.017201+0000","last_clean_scrub_stamp":"2024-04-26T23:34:44.017201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":202439,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":102,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":404878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834577060,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":85395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834577059,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":229376,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834577059,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":839680,"data_stored":675739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834577059,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":446464,"data_stored":282736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834577059,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":83437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834577059,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":438272,"data_stored":282064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834577059,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":827392,"data_stored":673285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834577059,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":199217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-27T02:38:45.690 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.691 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.691 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.691 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.691 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.691 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.692 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.692 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.692 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.692 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.692 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.692 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.692 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.693 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.693 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.693 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.693 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.693 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.693 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.693 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.694 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.694 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.694 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.694 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.694 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.694 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.694 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.695 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.695 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.695 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.695 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.695 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.695 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.695 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.696 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.696 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.696 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.696 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.696 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.696 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.697 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.697 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.697 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.697 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.697 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.697 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.697 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.698 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.698 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.698 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.698 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.698 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.698 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.698 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.699 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.699 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.699 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.699 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.699 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.699 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.699 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.700 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.700 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.700 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.700 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.700 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.700 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.701 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.702 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.702 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.702 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.702 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.702 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.702 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.703 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.703 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T23:34:45.032056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.703 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-26T23:34:44.017201+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=34, tm_sec=44, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=27, tm_hour=2, tm_min=38, tm_sec=38, tm_wday=5, tm_yday=118, tm_isdst=0) 2024-04-27T02:38:45.703 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-27T02:39:05.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:39:05.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:39:05.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-27T02:39:05.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.953+0000 7f0c07000640 1 Processor -- start 2024-04-27T02:39:05.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.953+0000 7f0c07000640 1 -- start start 2024-04-27T02:39:05.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.954+0000 7f0c07000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0c000b37a0 0x7f0c000b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:05.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0c07000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0006e710 con 0x7f0c00140220 2024-04-27T02:39:05.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0c07000640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c000b63d0 con 0x7f0c0006e330 2024-04-27T02:39:05.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0c07000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0c000b1ec0 con 0x7f0c000b37a0 2024-04-27T02:39:05.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0bff400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0c000b37a0 0x7f0c000b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:05.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0bff400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0c000b37a0 0x7f0c000b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45826/0 (socket says 172.21.15.16:45826) 2024-04-27T02:39:05.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0bff400640 1 -- 172.21.15.16:0/4234567631 learned_addr learned my addr 172.21.15.16:0/4234567631 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:05.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0bff400640 1 -- 172.21.15.16:0/4234567631 >> v1:172.21.15.32:6789/0 conn(0x7f0c0006e330 legacy=0x7f0c00073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:05.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0bff400640 1 -- 172.21.15.16:0/4234567631 >> v1:172.21.15.16:6789/0 conn(0x7f0c00140220 legacy=0x7f0c001406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:05.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.955+0000 7f0bff400640 1 -- 172.21.15.16:0/4234567631 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c000b1870 con 0x7f0c000b37a0 2024-04-27T02:39:05.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.956+0000 7f0bff400640 1 --2- 172.21.15.16:0/4234567631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c000b37a0 0x7f0c000b3be0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009870 tx=0x7f0bec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e173a1395a70d server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:05.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0bfea00640 1 -- 172.21.15.16:0/4234567631 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec037070 con 0x7f0c000b37a0 2024-04-27T02:39:05.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0bfea00640 1 -- 172.21.15.16:0/4234567631 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec032440 con 0x7f0c000b37a0 2024-04-27T02:39:05.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0bfea00640 1 -- 172.21.15.16:0/4234567631 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec032810 con 0x7f0c000b37a0 2024-04-27T02:39:05.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0c07000640 1 -- 172.21.15.16:0/4234567631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c000b37a0 msgr2=0x7f0c000b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:05.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0c07000640 1 --2- 172.21.15.16:0/4234567631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c000b37a0 0x7f0c000b3be0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009870 tx=0x7f0bec02a210 comp rx=0 tx=0).stop 2024-04-27T02:39:05.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0c07000640 1 -- 172.21.15.16:0/4234567631 shutdown_connections 2024-04-27T02:39:05.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0c07000640 1 --2- 172.21.15.16:0/4234567631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c000b37a0 0x7f0c000b3be0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:05.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0c07000640 1 -- 172.21.15.16:0/4234567631 >> 172.21.15.16:0/4234567631 conn(0x7f0c000b6630 msgr2=0x7f0c000b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:05.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0c07000640 1 -- 172.21.15.16:0/4234567631 shutdown_connections 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.957+0000 7f0c07000640 1 -- 172.21.15.16:0/4234567631 wait complete. 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.959+0000 7f0c07000640 1 Processor -- start 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.959+0000 7f0c07000640 1 -- start start 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0c07000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c0006e330 0x7f0c001df620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0c07000640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000b37a0 0x7f0c00135020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0c07000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0c00140220 0x7f0c00135560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0c07000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c00151f30 con 0x7f0c0006e330 2024-04-27T02:39:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0c07000640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f0c00151db0 con 0x7f0c000b37a0 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0c07000640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f0c001520b0 con 0x7f0c00140220 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c0006e330 0x7f0c001df620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0bffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c0006e330 0x7f0c001df620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45832/0 (socket says 172.21.15.16:45832) 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0bffe00640 1 -- 172.21.15.16:0/3960676561 learned_addr learned my addr 172.21.15.16:0/3960676561 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0bffe00640 1 -- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0c00140220 msgr2=0x7f0c00135560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0bffe00640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0c00140220 0x7f0c00135560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0bff400640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000b37a0 0x7f0c00135020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:05.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.960+0000 7f0bffe00640 1 -- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000b37a0 msgr2=0x7f0c00135020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0bffe00640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000b37a0 0x7f0c00135020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0bffe00640 1 -- 172.21.15.16:0/3960676561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c001376d0 con 0x7f0c0006e330 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0bffe00640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c0006e330 0x7f0c001df620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c460 tx=0x7f0bf000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0bf7e00640 1 -- 172.21.15.16:0/3960676561 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0016020 con 0x7f0c0006e330 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0bf7e00640 1 -- 172.21.15.16:0/3960676561 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf0012870 con 0x7f0c0006e330 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c00149a00 con 0x7f0c0006e330 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0bf7e00640 1 -- 172.21.15.16:0/3960676561 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0012c60 con 0x7f0c0006e330 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.961+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c00147610 con 0x7f0c0006e330 2024-04-27T02:39:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.962+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c000693a0 con 0x7f0c0006e330 2024-04-27T02:39:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.964+0000 7f0bf7e00640 1 -- 172.21.15.16:0/3960676561 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bf0019020 con 0x7f0c0006e330 2024-04-27T02:39:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.965+0000 7f0bf7e00640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0be006c920 0x7f0be006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:05.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.965+0000 7f0bf7e00640 1 -- 172.21.15.16:0/3960676561 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f0bf008b610 con 0x7f0c0006e330 2024-04-27T02:39:05.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.965+0000 7f0bff400640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0be006c920 0x7f0be006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:05.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.966+0000 7f0bff400640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0be006c920 0x7f0be006ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0bec034000 tx=0x7f0bec02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:05.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:05.970+0000 7f0bf7e00640 1 -- 172.21.15.16:0/3960676561 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0bf0020070 con 0x7f0c0006e330 2024-04-27T02:39:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.168+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 --> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c000b6cf0 con 0x7f0be006c920 2024-04-27T02:39:06.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.188+0000 7f0bf7e00640 1 -- 172.21.15.16:0/3960676561 <== mgr.4108 v2:172.21.15.32:6832/1413279187 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252140 (secure 0 0 0) 0x7f0c000b6cf0 con 0x7f0be006c920 2024-04-27T02:39:06.164 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:39:06.167 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-27T02:39:06.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0be006c920 msgr2=0x7f0be006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0be006c920 0x7f0be006ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0bec034000 tx=0x7f0bec02e000 comp rx=0 tx=0).stop 2024-04-27T02:39:06.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c0006e330 msgr2=0x7f0c001df620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c0006e330 0x7f0c001df620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c460 tx=0x7f0bf000c920 comp rx=0 tx=0).stop 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 shutdown_connections 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f0be006c920 0x7f0be006ede0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0c000b37a0 0x7f0c00135020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f0c00140220 0x7f0c00135560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 --2- 172.21.15.16:0/3960676561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c0006e330 0x7f0c001df620 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.194+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 >> 172.21.15.16:0/3960676561 conn(0x7f0c000b6630 msgr2=0x7f0c0013e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:06.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.195+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 shutdown_connections 2024-04-27T02:39:06.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.195+0000 7f0c07000640 1 -- 172.21.15.16:0/3960676561 wait complete. 2024-04-27T02:39:06.190 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":5547,"stamp":"2024-04-27T02:39:06.164719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":792815,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":147,"num_read_kb":130,"num_write":329,"num_write_kb":3713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5126,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":324,"ondisk_log_size":324,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252824,"kb_used_data":3416,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721896,"statfs":{"total":773094113280,"available":772835221504,"internally_reserved":0,"allocated":3497984,"data_stored":2248406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:51.530159+0000","last_change":"2024-04-27T02:38:51.530159+0000","last_active":"2024-04-27T02:38:51.530159+0000","last_peered":"2024-04-27T02:38:51.530159+0000","last_clean":"2024-04-27T02:38:51.530159+0000","last_became_active":"2024-04-26T23:35:33.822081+0000","last_became_peered":"2024-04-26T23:35:33.822081+0000","last_unstale":"2024-04-27T02:38:51.530159+0000","last_undegraded":"2024-04-27T02:38:51.530159+0000","last_fullsized":"2024-04-27T02:38:51.530159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:51.529898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:51.529898+0000","last_clean_scrub_stamp":"2024-04-27T02:38:51.529898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:09.030077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:51.176857+0000","last_change":"2024-04-27T02:38:51.176913+0000","last_active":"2024-04-27T02:38:51.176857+0000","last_peered":"2024-04-27T02:38:51.176857+0000","last_clean":"2024-04-27T02:38:51.176857+0000","last_became_active":"2024-04-26T23:34:46.104176+0000","last_became_peered":"2024-04-26T23:34:46.104176+0000","last_unstale":"2024-04-27T02:38:51.176857+0000","last_undegraded":"2024-04-27T02:38:51.176857+0000","last_fullsized":"2024-04-27T02:38:51.176857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:51.176653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:51.176653+0000","last_clean_scrub_stamp":"2024-04-27T02:38:51.176653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:02:43.841638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"22'1","reported_seq":114,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:55.196631+0000","last_change":"2024-04-27T02:38:55.196690+0000","last_active":"2024-04-27T02:38:55.196631+0000","last_peered":"2024-04-27T02:38:55.196631+0000","last_clean":"2024-04-27T02:38:55.196631+0000","last_became_active":"2024-04-26T23:34:46.107353+0000","last_became_peered":"2024-04-26T23:34:46.107353+0000","last_unstale":"2024-04-27T02:38:55.196631+0000","last_undegraded":"2024-04-27T02:38:55.196631+0000","last_fullsized":"2024-04-27T02:38:55.196631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:55.196432+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:55.196432+0000","last_clean_scrub_stamp":"2024-04-27T02:38:55.196432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:50.778602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":116,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.901443+0000","last_change":"2024-04-27T02:38:43.901510+0000","last_active":"2024-04-27T02:38:43.901443+0000","last_peered":"2024-04-27T02:38:43.901443+0000","last_clean":"2024-04-27T02:38:43.901443+0000","last_became_active":"2024-04-26T23:34:46.102370+0000","last_became_peered":"2024-04-26T23:34:46.102370+0000","last_unstale":"2024-04-27T02:38:43.901443+0000","last_undegraded":"2024-04-27T02:38:43.901443+0000","last_fullsized":"2024-04-27T02:38:43.901443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:43.901234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:43.901234+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.901234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:06:55.448623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:55.607260+0000","last_change":"2024-04-27T02:38:55.607321+0000","last_active":"2024-04-27T02:38:55.607260+0000","last_peered":"2024-04-27T02:38:55.607260+0000","last_clean":"2024-04-27T02:38:55.607260+0000","last_became_active":"2024-04-26T23:34:46.114391+0000","last_became_peered":"2024-04-26T23:34:46.114391+0000","last_unstale":"2024-04-27T02:38:55.607260+0000","last_undegraded":"2024-04-27T02:38:55.607260+0000","last_fullsized":"2024-04-27T02:38:55.607260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:55.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:55.607024+0000","last_clean_scrub_stamp":"2024-04-27T02:38:55.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:10.536279+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.904396+0000","last_change":"2024-04-27T02:38:45.904500+0000","last_active":"2024-04-27T02:38:45.904396+0000","last_peered":"2024-04-27T02:38:45.904396+0000","last_clean":"2024-04-27T02:38:45.904396+0000","last_became_active":"2024-04-26T23:34:46.103308+0000","last_became_peered":"2024-04-26T23:34:46.103308+0000","last_unstale":"2024-04-27T02:38:45.904396+0000","last_undegraded":"2024-04-27T02:38:45.904396+0000","last_fullsized":"2024-04-27T02:38:45.904396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:45.903969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:45.903969+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.903969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:14:53.007830+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.690885+0000","last_change":"2024-04-27T02:38:46.690938+0000","last_active":"2024-04-27T02:38:46.690885+0000","last_peered":"2024-04-27T02:38:46.690885+0000","last_clean":"2024-04-27T02:38:46.690885+0000","last_became_active":"2024-04-26T23:34:46.076319+0000","last_became_peered":"2024-04-26T23:34:46.076319+0000","last_unstale":"2024-04-27T02:38:46.690885+0000","last_undegraded":"2024-04-27T02:38:46.690885+0000","last_fullsized":"2024-04-27T02:38:46.690885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:46.690690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:46.690690+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.690690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:02:39.355675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:59.247590+0000","last_change":"2024-04-27T02:38:59.247646+0000","last_active":"2024-04-27T02:38:59.247590+0000","last_peered":"2024-04-27T02:38:59.247590+0000","last_clean":"2024-04-27T02:38:59.247590+0000","last_became_active":"2024-04-26T23:34:46.115649+0000","last_became_peered":"2024-04-26T23:34:46.115649+0000","last_unstale":"2024-04-27T02:38:59.247590+0000","last_undegraded":"2024-04-27T02:38:59.247590+0000","last_fullsized":"2024-04-27T02:38:59.247590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:59.247335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:59.247335+0000","last_clean_scrub_stamp":"2024-04-27T02:38:59.247335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:44.025116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:44.057126+0000","last_change":"2024-04-27T02:38:44.057126+0000","last_active":"2024-04-27T02:38:44.057126+0000","last_peered":"2024-04-27T02:38:44.057126+0000","last_clean":"2024-04-27T02:38:44.057126+0000","last_became_active":"2024-04-26T23:34:46.098487+0000","last_became_peered":"2024-04-26T23:34:46.098487+0000","last_unstale":"2024-04-27T02:38:44.057126+0000","last_undegraded":"2024-04-27T02:38:44.057126+0000","last_fullsized":"2024-04-27T02:38:44.057126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:44.056989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:44.056989+0000","last_clean_scrub_stamp":"2024-04-27T02:38:44.056989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:06:55.604378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"22'3","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:53.617979+0000","last_change":"2024-04-27T02:38:53.618038+0000","last_active":"2024-04-27T02:38:53.617979+0000","last_peered":"2024-04-27T02:38:53.617979+0000","last_clean":"2024-04-27T02:38:53.617979+0000","last_became_active":"2024-04-26T23:34:46.108197+0000","last_became_peered":"2024-04-26T23:34:46.108197+0000","last_unstale":"2024-04-27T02:38:53.617979+0000","last_undegraded":"2024-04-27T02:38:53.617979+0000","last_fullsized":"2024-04-27T02:38:53.617979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-27T02:38:53.617766+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-27T02:38:53.617766+0000","last_clean_scrub_stamp":"2024-04-27T02:38:53.617766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T14:38:33.948672+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:48.658059+0000","last_change":"2024-04-27T02:38:48.658138+0000","last_active":"2024-04-27T02:38:48.658059+0000","last_peered":"2024-04-27T02:38:48.658059+0000","last_clean":"2024-04-27T02:38:48.658059+0000","last_became_active":"2024-04-26T23:34:46.091137+0000","last_became_peered":"2024-04-26T23:34:46.091137+0000","last_unstale":"2024-04-27T02:38:48.658059+0000","last_undegraded":"2024-04-27T02:38:48.658059+0000","last_fullsized":"2024-04-27T02:38:48.658059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:48.657858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:48.657858+0000","last_clean_scrub_stamp":"2024-04-27T02:38:48.657858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:41.749915+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:50.667947+0000","last_change":"2024-04-27T02:38:50.668001+0000","last_active":"2024-04-27T02:38:50.667947+0000","last_peered":"2024-04-27T02:38:50.667947+0000","last_clean":"2024-04-27T02:38:50.667947+0000","last_became_active":"2024-04-26T23:34:46.097858+0000","last_became_peered":"2024-04-26T23:34:46.097858+0000","last_unstale":"2024-04-27T02:38:50.667947+0000","last_undegraded":"2024-04-27T02:38:50.667947+0000","last_fullsized":"2024-04-27T02:38:50.667947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:50.667727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:50.667727+0000","last_clean_scrub_stamp":"2024-04-27T02:38:50.667727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:46.249897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:50.882010+0000","last_change":"2024-04-27T02:38:50.882068+0000","last_active":"2024-04-27T02:38:50.882010+0000","last_peered":"2024-04-27T02:38:50.882010+0000","last_clean":"2024-04-27T02:38:50.882010+0000","last_became_active":"2024-04-26T23:34:46.100445+0000","last_became_peered":"2024-04-26T23:34:46.100445+0000","last_unstale":"2024-04-27T02:38:50.882010+0000","last_undegraded":"2024-04-27T02:38:50.882010+0000","last_fullsized":"2024-04-27T02:38:50.882010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:50.881756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:50.881756+0000","last_clean_scrub_stamp":"2024-04-27T02:38:50.881756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:09:12.342171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.885434+0000","last_change":"2024-04-27T02:38:47.885493+0000","last_active":"2024-04-27T02:38:47.885434+0000","last_peered":"2024-04-27T02:38:47.885434+0000","last_clean":"2024-04-27T02:38:47.885434+0000","last_became_active":"2024-04-26T23:34:46.089459+0000","last_became_peered":"2024-04-26T23:34:46.089459+0000","last_unstale":"2024-04-27T02:38:47.885434+0000","last_undegraded":"2024-04-27T02:38:47.885434+0000","last_fullsized":"2024-04-27T02:38:47.885434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:47.885200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:47.885200+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.885200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:51:54.410550+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:49.180622+0000","last_change":"2024-04-27T02:38:49.180676+0000","last_active":"2024-04-27T02:38:49.180622+0000","last_peered":"2024-04-27T02:38:49.180622+0000","last_clean":"2024-04-27T02:38:49.180622+0000","last_became_active":"2024-04-26T23:34:46.099167+0000","last_became_peered":"2024-04-26T23:34:46.099167+0000","last_unstale":"2024-04-27T02:38:49.180622+0000","last_undegraded":"2024-04-27T02:38:49.180622+0000","last_fullsized":"2024-04-27T02:38:49.180622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:49.180405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:49.180405+0000","last_clean_scrub_stamp":"2024-04-27T02:38:49.180405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:13.208750+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"22'1","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:58.484079+0000","last_change":"2024-04-27T02:38:58.484220+0000","last_active":"2024-04-27T02:38:58.484079+0000","last_peered":"2024-04-27T02:38:58.484079+0000","last_clean":"2024-04-27T02:38:58.484079+0000","last_became_active":"2024-04-26T23:34:46.102160+0000","last_became_peered":"2024-04-26T23:34:46.102160+0000","last_unstale":"2024-04-27T02:38:58.484079+0000","last_undegraded":"2024-04-27T02:38:58.484079+0000","last_fullsized":"2024-04-27T02:38:58.484079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:58.483820+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:58.483820+0000","last_clean_scrub_stamp":"2024-04-27T02:38:58.483820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:55:11.775495+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.682608+0000","last_change":"2024-04-27T02:38:45.682665+0000","last_active":"2024-04-27T02:38:45.682608+0000","last_peered":"2024-04-27T02:38:45.682608+0000","last_clean":"2024-04-27T02:38:45.682608+0000","last_became_active":"2024-04-26T23:34:46.094762+0000","last_became_peered":"2024-04-26T23:34:46.094762+0000","last_unstale":"2024-04-27T02:38:45.682608+0000","last_undegraded":"2024-04-27T02:38:45.682608+0000","last_fullsized":"2024-04-27T02:38:45.682608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:45.682402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:45.682402+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.682402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:02:38.347387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:50.539339+0000","last_change":"2024-04-27T02:38:50.539403+0000","last_active":"2024-04-27T02:38:50.539339+0000","last_peered":"2024-04-27T02:38:50.539339+0000","last_clean":"2024-04-27T02:38:50.539339+0000","last_became_active":"2024-04-26T23:34:46.109241+0000","last_became_peered":"2024-04-26T23:34:46.109241+0000","last_unstale":"2024-04-27T02:38:50.539339+0000","last_undegraded":"2024-04-27T02:38:50.539339+0000","last_fullsized":"2024-04-27T02:38:50.539339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:50.539106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:50.539106+0000","last_clean_scrub_stamp":"2024-04-27T02:38:50.539106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:33.526198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:44.694510+0000","last_change":"2024-04-27T02:38:44.694547+0000","last_active":"2024-04-27T02:38:44.694510+0000","last_peered":"2024-04-27T02:38:44.694510+0000","last_clean":"2024-04-27T02:38:44.694510+0000","last_became_active":"2024-04-26T23:34:46.091579+0000","last_became_peered":"2024-04-26T23:34:46.091579+0000","last_unstale":"2024-04-27T02:38:44.694510+0000","last_undegraded":"2024-04-27T02:38:44.694510+0000","last_fullsized":"2024-04-27T02:38:44.694510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:44.694394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:44.694394+0000","last_clean_scrub_stamp":"2024-04-27T02:38:44.694394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:45.585997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"22'1","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:49.644983+0000","last_change":"2024-04-27T02:38:49.645047+0000","last_active":"2024-04-27T02:38:49.644983+0000","last_peered":"2024-04-27T02:38:49.644983+0000","last_clean":"2024-04-27T02:38:49.644983+0000","last_became_active":"2024-04-26T23:34:46.095187+0000","last_became_peered":"2024-04-26T23:34:46.095187+0000","last_unstale":"2024-04-27T02:38:49.644983+0000","last_undegraded":"2024-04-27T02:38:49.644983+0000","last_fullsized":"2024-04-27T02:38:49.644983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:49.644772+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:49.644772+0000","last_clean_scrub_stamp":"2024-04-27T02:38:49.644772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:42:49.012083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"22'3","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:53.912414+0000","last_change":"2024-04-27T02:38:53.912487+0000","last_active":"2024-04-27T02:38:53.912414+0000","last_peered":"2024-04-27T02:38:53.912414+0000","last_clean":"2024-04-27T02:38:53.912414+0000","last_became_active":"2024-04-26T23:34:46.105045+0000","last_became_peered":"2024-04-26T23:34:46.105045+0000","last_unstale":"2024-04-27T02:38:53.912414+0000","last_undegraded":"2024-04-27T02:38:53.912414+0000","last_fullsized":"2024-04-27T02:38:53.912414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-27T02:38:53.912084+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-27T02:38:53.912084+0000","last_clean_scrub_stamp":"2024-04-27T02:38:53.912084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.803687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"22'1","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.022492+0000","last_change":"2024-04-27T02:38:43.022536+0000","last_active":"2024-04-27T02:38:43.022492+0000","last_peered":"2024-04-27T02:38:43.022492+0000","last_clean":"2024-04-27T02:38:43.022492+0000","last_became_active":"2024-04-26T23:34:46.091699+0000","last_became_peered":"2024-04-26T23:34:46.091699+0000","last_unstale":"2024-04-27T02:38:43.022492+0000","last_undegraded":"2024-04-27T02:38:43.022492+0000","last_fullsized":"2024-04-27T02:38:43.022492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:43.022372+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:43.022372+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.022372+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:23.160083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:54.197952+0000","last_change":"2024-04-27T02:38:54.198005+0000","last_active":"2024-04-27T02:38:54.197952+0000","last_peered":"2024-04-27T02:38:54.197952+0000","last_clean":"2024-04-27T02:38:54.197952+0000","last_became_active":"2024-04-26T23:34:46.108476+0000","last_became_peered":"2024-04-26T23:34:46.108476+0000","last_unstale":"2024-04-27T02:38:54.197952+0000","last_undegraded":"2024-04-27T02:38:54.197952+0000","last_fullsized":"2024-04-27T02:38:54.197952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:54.197713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:54.197713+0000","last_clean_scrub_stamp":"2024-04-27T02:38:54.197713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:54.393612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"22'6","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:39:02.454105+0000","last_change":"2024-04-27T02:39:02.454210+0000","last_active":"2024-04-27T02:39:02.454105+0000","last_peered":"2024-04-27T02:39:02.454105+0000","last_clean":"2024-04-27T02:39:02.454105+0000","last_became_active":"2024-04-26T23:34:46.118977+0000","last_became_peered":"2024-04-26T23:34:46.118977+0000","last_unstale":"2024-04-27T02:39:02.454105+0000","last_undegraded":"2024-04-27T02:39:02.454105+0000","last_fullsized":"2024-04-27T02:39:02.454105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-27T02:39:02.453828+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-27T02:39:02.453828+0000","last_clean_scrub_stamp":"2024-04-27T02:39:02.453828+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:20:32.589650+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:57.198790+0000","last_change":"2024-04-27T02:38:57.198790+0000","last_active":"2024-04-27T02:38:57.198790+0000","last_peered":"2024-04-27T02:38:57.198790+0000","last_clean":"2024-04-27T02:38:57.198790+0000","last_became_active":"2024-04-26T23:34:46.108109+0000","last_became_peered":"2024-04-26T23:34:46.108109+0000","last_unstale":"2024-04-27T02:38:57.198790+0000","last_undegraded":"2024-04-27T02:38:57.198790+0000","last_fullsized":"2024-04-27T02:38:57.198790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:57.198507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:57.198507+0000","last_clean_scrub_stamp":"2024-04-27T02:38:57.198507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:16.088485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.863502+0000","last_change":"2024-04-27T02:38:46.863502+0000","last_active":"2024-04-27T02:38:46.863502+0000","last_peered":"2024-04-27T02:38:46.863502+0000","last_clean":"2024-04-27T02:38:46.863502+0000","last_became_active":"2024-04-26T23:34:46.104891+0000","last_became_peered":"2024-04-26T23:34:46.104891+0000","last_unstale":"2024-04-27T02:38:46.863502+0000","last_undegraded":"2024-04-27T02:38:46.863502+0000","last_fullsized":"2024-04-27T02:38:46.863502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:46.863226+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:46.863226+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.863226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:27:04.363405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:49.931273+0000","last_change":"2024-04-27T02:38:49.931273+0000","last_active":"2024-04-27T02:38:49.931273+0000","last_peered":"2024-04-27T02:38:49.931273+0000","last_clean":"2024-04-27T02:38:49.931273+0000","last_became_active":"2024-04-26T23:34:46.095689+0000","last_became_peered":"2024-04-26T23:34:46.095689+0000","last_unstale":"2024-04-27T02:38:49.931273+0000","last_undegraded":"2024-04-27T02:38:49.931273+0000","last_fullsized":"2024-04-27T02:38:49.931273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:49.930981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:49.930981+0000","last_clean_scrub_stamp":"2024-04-27T02:38:49.930981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:11.371908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:48.884978+0000","last_change":"2024-04-27T02:38:48.884978+0000","last_active":"2024-04-27T02:38:48.884978+0000","last_peered":"2024-04-27T02:38:48.884978+0000","last_clean":"2024-04-27T02:38:48.884978+0000","last_became_active":"2024-04-26T23:34:46.095529+0000","last_became_peered":"2024-04-26T23:34:46.095529+0000","last_unstale":"2024-04-27T02:38:48.884978+0000","last_undegraded":"2024-04-27T02:38:48.884978+0000","last_fullsized":"2024-04-27T02:38:48.884978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:48.884729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:48.884729+0000","last_clean_scrub_stamp":"2024-04-27T02:38:48.884729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:50.078651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:53.188574+0000","last_change":"2024-04-27T02:38:53.188627+0000","last_active":"2024-04-27T02:38:53.188574+0000","last_peered":"2024-04-27T02:38:53.188574+0000","last_clean":"2024-04-27T02:38:53.188574+0000","last_became_active":"2024-04-26T23:34:46.107121+0000","last_became_peered":"2024-04-26T23:34:46.107121+0000","last_unstale":"2024-04-27T02:38:53.188574+0000","last_undegraded":"2024-04-27T02:38:53.188574+0000","last_fullsized":"2024-04-27T02:38:53.188574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:53.188372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:53.188372+0000","last_clean_scrub_stamp":"2024-04-27T02:38:53.188372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:30.807664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:59.519754+0000","last_change":"2024-04-27T02:38:59.519867+0000","last_active":"2024-04-27T02:38:59.519754+0000","last_peered":"2024-04-27T02:38:59.519754+0000","last_clean":"2024-04-27T02:38:59.519754+0000","last_became_active":"2024-04-26T23:34:46.104182+0000","last_became_peered":"2024-04-26T23:34:46.104182+0000","last_unstale":"2024-04-27T02:38:59.519754+0000","last_undegraded":"2024-04-27T02:38:59.519754+0000","last_fullsized":"2024-04-27T02:38:59.519754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:59.519499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:59.519499+0000","last_clean_scrub_stamp":"2024-04-27T02:38:59.519499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:24:26.075656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:48.555250+0000","last_change":"2024-04-27T02:38:48.555407+0000","last_active":"2024-04-27T02:38:48.555250+0000","last_peered":"2024-04-27T02:38:48.555250+0000","last_clean":"2024-04-27T02:38:48.555250+0000","last_became_active":"2024-04-26T23:34:46.089303+0000","last_became_peered":"2024-04-26T23:34:46.089303+0000","last_unstale":"2024-04-27T02:38:48.555250+0000","last_undegraded":"2024-04-27T02:38:48.555250+0000","last_fullsized":"2024-04-27T02:38:48.555250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:48.555013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:48.555013+0000","last_clean_scrub_stamp":"2024-04-27T02:38:48.555013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:41:00.617756+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.925236+0000","last_change":"2024-04-27T02:38:42.925288+0000","last_active":"2024-04-27T02:38:42.925236+0000","last_peered":"2024-04-27T02:38:42.925236+0000","last_clean":"2024-04-27T02:38:42.925236+0000","last_became_active":"2024-04-26T23:34:46.098646+0000","last_became_peered":"2024-04-26T23:34:46.098646+0000","last_unstale":"2024-04-27T02:38:42.925236+0000","last_undegraded":"2024-04-27T02:38:42.925236+0000","last_fullsized":"2024-04-27T02:38:42.925236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:42.924973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:42.924973+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.924973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:23.062684+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.103032+0000","last_change":"2024-04-27T02:38:46.103202+0000","last_active":"2024-04-27T02:38:46.103032+0000","last_peered":"2024-04-27T02:38:46.103032+0000","last_clean":"2024-04-27T02:38:46.103032+0000","last_became_active":"2024-04-26T23:34:46.114342+0000","last_became_peered":"2024-04-26T23:34:46.114342+0000","last_unstale":"2024-04-27T02:38:46.103032+0000","last_undegraded":"2024-04-27T02:38:46.103032+0000","last_fullsized":"2024-04-27T02:38:46.103032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:46.102780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:46.102780+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.102780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:29.089872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'2","reported_seq":102,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.163968+0000","last_change":"2024-04-27T02:38:46.164030+0000","last_active":"2024-04-27T02:38:46.163968+0000","last_peered":"2024-04-27T02:38:46.163968+0000","last_clean":"2024-04-27T02:38:46.163968+0000","last_became_active":"2024-04-26T23:34:45.083025+0000","last_became_peered":"2024-04-26T23:34:45.083025+0000","last_unstale":"2024-04-27T02:38:46.163968+0000","last_undegraded":"2024-04-27T02:38:46.163968+0000","last_fullsized":"2024-04-27T02:38:46.163968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-27T02:38:46.163724+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-27T02:38:46.163724+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.163724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:47:40.299498+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:50.882417+0000","last_change":"2024-04-27T02:38:50.882473+0000","last_active":"2024-04-27T02:38:50.882417+0000","last_peered":"2024-04-27T02:38:50.882417+0000","last_clean":"2024-04-27T02:38:50.882417+0000","last_became_active":"2024-04-26T23:34:46.081342+0000","last_became_peered":"2024-04-26T23:34:46.081342+0000","last_unstale":"2024-04-27T02:38:50.882417+0000","last_undegraded":"2024-04-27T02:38:50.882417+0000","last_fullsized":"2024-04-27T02:38:50.882417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:50.882182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:50.882182+0000","last_clean_scrub_stamp":"2024-04-27T02:38:50.882182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:56.772640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.639793+0000","last_change":"2024-04-27T02:38:46.639852+0000","last_active":"2024-04-27T02:38:46.639793+0000","last_peered":"2024-04-27T02:38:46.639793+0000","last_clean":"2024-04-27T02:38:46.639793+0000","last_became_active":"2024-04-26T23:34:45.083961+0000","last_became_peered":"2024-04-26T23:34:45.083961+0000","last_unstale":"2024-04-27T02:38:46.639793+0000","last_undegraded":"2024-04-27T02:38:46.639793+0000","last_fullsized":"2024-04-27T02:38:46.639793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-27T02:38:46.639562+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-27T02:38:46.639562+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.639562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:14:25.778609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.892126+0000","last_change":"2024-04-27T02:38:45.892126+0000","last_active":"2024-04-27T02:38:45.892126+0000","last_peered":"2024-04-27T02:38:45.892126+0000","last_clean":"2024-04-27T02:38:45.892126+0000","last_became_active":"2024-04-26T23:34:45.080506+0000","last_became_peered":"2024-04-26T23:34:45.080506+0000","last_unstale":"2024-04-27T02:38:45.892126+0000","last_undegraded":"2024-04-27T02:38:45.892126+0000","last_fullsized":"2024-04-27T02:38:45.892126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-27T02:38:45.891750+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-27T02:38:45.891750+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.891750+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:14:52.995610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:48.204744+0000","last_change":"2024-04-27T02:38:48.204798+0000","last_active":"2024-04-27T02:38:48.204744+0000","last_peered":"2024-04-27T02:38:48.204744+0000","last_clean":"2024-04-27T02:38:48.204744+0000","last_became_active":"2024-04-26T23:34:46.099123+0000","last_became_peered":"2024-04-26T23:34:46.099123+0000","last_unstale":"2024-04-27T02:38:48.204744+0000","last_undegraded":"2024-04-27T02:38:48.204744+0000","last_fullsized":"2024-04-27T02:38:48.204744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:48.204553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:48.204553+0000","last_clean_scrub_stamp":"2024-04-27T02:38:48.204553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:07:38.667868+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.592961+0000","last_change":"2024-04-27T02:38:47.593016+0000","last_active":"2024-04-27T02:38:47.592961+0000","last_peered":"2024-04-27T02:38:47.592961+0000","last_clean":"2024-04-27T02:38:47.592961+0000","last_became_active":"2024-04-26T23:34:45.072614+0000","last_became_peered":"2024-04-26T23:34:45.072614+0000","last_unstale":"2024-04-27T02:38:47.592961+0000","last_undegraded":"2024-04-27T02:38:47.592961+0000","last_fullsized":"2024-04-27T02:38:47.592961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:47.592759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:47.592759+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.592759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:40.684817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:51.892992+0000","last_change":"2024-04-27T02:38:51.892992+0000","last_active":"2024-04-27T02:38:51.892992+0000","last_peered":"2024-04-27T02:38:51.892992+0000","last_clean":"2024-04-27T02:38:51.892992+0000","last_became_active":"2024-04-26T23:34:46.090239+0000","last_became_peered":"2024-04-26T23:34:46.090239+0000","last_unstale":"2024-04-27T02:38:51.892992+0000","last_undegraded":"2024-04-27T02:38:51.892992+0000","last_fullsized":"2024-04-27T02:38:51.892992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:51.892732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:51.892732+0000","last_clean_scrub_stamp":"2024-04-27T02:38:51.892732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:54:29.511098+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.031844+0000","last_change":"2024-04-27T02:38:42.031905+0000","last_active":"2024-04-27T02:38:42.031844+0000","last_peered":"2024-04-27T02:38:42.031844+0000","last_clean":"2024-04-27T02:38:42.031844+0000","last_became_active":"2024-04-26T23:34:45.073222+0000","last_became_peered":"2024-04-26T23:34:45.073222+0000","last_unstale":"2024-04-27T02:38:42.031844+0000","last_undegraded":"2024-04-27T02:38:42.031844+0000","last_fullsized":"2024-04-27T02:38:42.031844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:42.031622+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:42.031622+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.031622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:17.717674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.898208+0000","last_change":"2024-04-27T02:38:47.898263+0000","last_active":"2024-04-27T02:38:47.898208+0000","last_peered":"2024-04-27T02:38:47.898208+0000","last_clean":"2024-04-27T02:38:47.898208+0000","last_became_active":"2024-04-26T23:34:46.105709+0000","last_became_peered":"2024-04-26T23:34:46.105709+0000","last_unstale":"2024-04-27T02:38:47.898208+0000","last_undegraded":"2024-04-27T02:38:47.898208+0000","last_fullsized":"2024-04-27T02:38:47.898208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:47.897973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:47.897973+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.897973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T14:01:30.897009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'1","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:40.695830+0000","last_change":"2024-04-27T02:38:40.695889+0000","last_active":"2024-04-27T02:38:40.695830+0000","last_peered":"2024-04-27T02:38:40.695830+0000","last_clean":"2024-04-27T02:38:40.695830+0000","last_became_active":"2024-04-26T23:34:45.073476+0000","last_became_peered":"2024-04-26T23:34:45.073476+0000","last_unstale":"2024-04-27T02:38:40.695830+0000","last_undegraded":"2024-04-27T02:38:40.695830+0000","last_fullsized":"2024-04-27T02:38:40.695830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:40.695623+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:40.695623+0000","last_clean_scrub_stamp":"2024-04-27T02:38:40.695623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:58.686030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:58.209487+0000","last_change":"2024-04-27T02:38:58.209598+0000","last_active":"2024-04-27T02:38:58.209487+0000","last_peered":"2024-04-27T02:38:58.209487+0000","last_clean":"2024-04-27T02:38:58.209487+0000","last_became_active":"2024-04-26T23:34:46.119378+0000","last_became_peered":"2024-04-26T23:34:46.119378+0000","last_unstale":"2024-04-27T02:38:58.209487+0000","last_undegraded":"2024-04-27T02:38:58.209487+0000","last_fullsized":"2024-04-27T02:38:58.209487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:58.209160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:58.209160+0000","last_clean_scrub_stamp":"2024-04-27T02:38:58.209160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:21.526526+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'7","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.559348+0000","last_change":"2024-04-27T02:38:45.559425+0000","last_active":"2024-04-27T02:38:45.559348+0000","last_peered":"2024-04-27T02:38:45.559348+0000","last_clean":"2024-04-27T02:38:45.559348+0000","last_became_active":"2024-04-26T23:34:45.073699+0000","last_became_peered":"2024-04-26T23:34:45.073699+0000","last_unstale":"2024-04-27T02:38:45.559348+0000","last_undegraded":"2024-04-27T02:38:45.559348+0000","last_fullsized":"2024-04-27T02:38:45.559348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-04-27T02:38:45.559108+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-04-27T02:38:45.559108+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.559108+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:39.323772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:39:01.483846+0000","last_change":"2024-04-27T02:39:01.483904+0000","last_active":"2024-04-27T02:39:01.483846+0000","last_peered":"2024-04-27T02:39:01.483846+0000","last_clean":"2024-04-27T02:39:01.483846+0000","last_became_active":"2024-04-26T23:34:46.106767+0000","last_became_peered":"2024-04-26T23:34:46.106767+0000","last_unstale":"2024-04-27T02:39:01.483846+0000","last_undegraded":"2024-04-27T02:39:01.483846+0000","last_fullsized":"2024-04-27T02:39:01.483846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:39:01.483646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:39:01.483646+0000","last_clean_scrub_stamp":"2024-04-27T02:39:01.483646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:08:48.896673+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'59","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:41.941442+0000","last_change":"2024-04-27T02:38:41.941491+0000","last_active":"2024-04-27T02:38:41.941442+0000","last_peered":"2024-04-27T02:38:41.941442+0000","last_clean":"2024-04-27T02:38:41.941442+0000","last_became_active":"2024-04-26T23:34:45.073896+0000","last_became_peered":"2024-04-26T23:34:45.073896+0000","last_unstale":"2024-04-27T02:38:41.941442+0000","last_undegraded":"2024-04-27T02:38:41.941442+0000","last_fullsized":"2024-04-27T02:38:41.941442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-04-27T02:38:41.941294+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-04-27T02:38:41.941294+0000","last_clean_scrub_stamp":"2024-04-27T02:38:41.941294+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:17.627346+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199217,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":101,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:51.635254+0000","last_change":"2024-04-27T02:38:51.635313+0000","last_active":"2024-04-27T02:38:51.635254+0000","last_peered":"2024-04-27T02:38:51.635254+0000","last_clean":"2024-04-27T02:38:51.635254+0000","last_became_active":"2024-04-26T23:34:46.098334+0000","last_became_peered":"2024-04-26T23:34:46.098334+0000","last_unstale":"2024-04-27T02:38:51.635254+0000","last_undegraded":"2024-04-27T02:38:51.635254+0000","last_fullsized":"2024-04-27T02:38:51.635254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:51.634950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:51.634950+0000","last_clean_scrub_stamp":"2024-04-27T02:38:51.634950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:18.766663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'5","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.558542+0000","last_change":"2024-04-27T02:38:47.558610+0000","last_active":"2024-04-27T02:38:47.558542+0000","last_peered":"2024-04-27T02:38:47.558542+0000","last_clean":"2024-04-27T02:38:47.558542+0000","last_became_active":"2024-04-26T23:34:45.082944+0000","last_became_peered":"2024-04-26T23:34:45.082944+0000","last_unstale":"2024-04-27T02:38:47.558542+0000","last_undegraded":"2024-04-27T02:38:47.558542+0000","last_fullsized":"2024-04-27T02:38:47.558542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-04-27T02:38:47.558289+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-04-27T02:38:47.558289+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.558289+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:28:27.696000+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:51.848034+0000","last_change":"2024-04-27T02:38:51.848096+0000","last_active":"2024-04-27T02:38:51.848034+0000","last_peered":"2024-04-27T02:38:51.848034+0000","last_clean":"2024-04-27T02:38:51.848034+0000","last_became_active":"2024-04-26T23:34:46.107425+0000","last_became_peered":"2024-04-26T23:34:46.107425+0000","last_unstale":"2024-04-27T02:38:51.848034+0000","last_undegraded":"2024-04-27T02:38:51.848034+0000","last_fullsized":"2024-04-27T02:38:51.848034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:51.847807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:51.847807+0000","last_clean_scrub_stamp":"2024-04-27T02:38:51.847807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:47:45.983581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:53.471417+0000","last_change":"2024-04-27T02:38:53.471472+0000","last_active":"2024-04-27T02:38:53.471417+0000","last_peered":"2024-04-27T02:38:53.471417+0000","last_clean":"2024-04-27T02:38:53.471417+0000","last_became_active":"2024-04-26T23:34:45.079077+0000","last_became_peered":"2024-04-26T23:34:45.079077+0000","last_unstale":"2024-04-27T02:38:53.471417+0000","last_undegraded":"2024-04-27T02:38:53.471417+0000","last_fullsized":"2024-04-27T02:38:53.471417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:53.471208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:53.471208+0000","last_clean_scrub_stamp":"2024-04-27T02:38:53.471208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:38.248989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.721273+0000","last_change":"2024-04-27T02:38:43.721326+0000","last_active":"2024-04-27T02:38:43.721273+0000","last_peered":"2024-04-27T02:38:43.721273+0000","last_clean":"2024-04-27T02:38:43.721273+0000","last_became_active":"2024-04-26T23:34:46.093487+0000","last_became_peered":"2024-04-26T23:34:46.093487+0000","last_unstale":"2024-04-27T02:38:43.721273+0000","last_undegraded":"2024-04-27T02:38:43.721273+0000","last_fullsized":"2024-04-27T02:38:43.721273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:43.720987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:43.720987+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.720987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:35.301346+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":105,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.665198+0000","last_change":"2024-04-27T02:38:45.665258+0000","last_active":"2024-04-27T02:38:45.665198+0000","last_peered":"2024-04-27T02:38:45.665198+0000","last_clean":"2024-04-27T02:38:45.665198+0000","last_became_active":"2024-04-26T23:34:45.086932+0000","last_became_peered":"2024-04-26T23:34:45.086932+0000","last_unstale":"2024-04-27T02:38:45.665198+0000","last_undegraded":"2024-04-27T02:38:45.665198+0000","last_fullsized":"2024-04-27T02:38:45.665198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:45.664937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:45.664937+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.664937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:46.556540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.061689+0000","last_change":"2024-04-27T02:38:47.061743+0000","last_active":"2024-04-27T02:38:47.061689+0000","last_peered":"2024-04-27T02:38:47.061689+0000","last_clean":"2024-04-27T02:38:47.061689+0000","last_became_active":"2024-04-26T23:34:46.119328+0000","last_became_peered":"2024-04-26T23:34:46.119328+0000","last_unstale":"2024-04-27T02:38:47.061689+0000","last_undegraded":"2024-04-27T02:38:47.061689+0000","last_fullsized":"2024-04-27T02:38:47.061689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:47.061489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:47.061489+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.061489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:51:53.586838+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'13","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.858016+0000","last_change":"2024-04-27T02:38:43.858109+0000","last_active":"2024-04-27T02:38:43.858016+0000","last_peered":"2024-04-27T02:38:43.858016+0000","last_clean":"2024-04-27T02:38:43.858016+0000","last_became_active":"2024-04-26T23:34:45.071969+0000","last_became_peered":"2024-04-26T23:34:45.071969+0000","last_unstale":"2024-04-27T02:38:43.858016+0000","last_undegraded":"2024-04-27T02:38:43.858016+0000","last_fullsized":"2024-04-27T02:38:43.858016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2024-04-27T02:38:43.857799+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2024-04-27T02:38:43.857799+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.857799+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:13:42.338064+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:39:00.493700+0000","last_change":"2024-04-27T02:39:00.493756+0000","last_active":"2024-04-27T02:39:00.493700+0000","last_peered":"2024-04-27T02:39:00.493700+0000","last_clean":"2024-04-27T02:39:00.493700+0000","last_became_active":"2024-04-26T23:34:46.107017+0000","last_became_peered":"2024-04-26T23:34:46.107017+0000","last_unstale":"2024-04-27T02:39:00.493700+0000","last_undegraded":"2024-04-27T02:39:00.493700+0000","last_fullsized":"2024-04-27T02:39:00.493700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:39:00.493482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:39:00.493482+0000","last_clean_scrub_stamp":"2024-04-27T02:39:00.493482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:21.354777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:44.668776+0000","last_change":"2024-04-27T02:38:44.668846+0000","last_active":"2024-04-27T02:38:44.668776+0000","last_peered":"2024-04-27T02:38:44.668776+0000","last_clean":"2024-04-27T02:38:44.668776+0000","last_became_active":"2024-04-26T23:34:45.084798+0000","last_became_peered":"2024-04-26T23:34:45.084798+0000","last_unstale":"2024-04-27T02:38:44.668776+0000","last_undegraded":"2024-04-27T02:38:44.668776+0000","last_fullsized":"2024-04-27T02:38:44.668776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-27T02:38:44.668566+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-27T02:38:44.668566+0000","last_clean_scrub_stamp":"2024-04-27T02:38:44.668566+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:36.248925+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:48.929683+0000","last_change":"2024-04-27T02:38:48.929739+0000","last_active":"2024-04-27T02:38:48.929683+0000","last_peered":"2024-04-27T02:38:48.929683+0000","last_clean":"2024-04-27T02:38:48.929683+0000","last_became_active":"2024-04-26T23:34:46.107280+0000","last_became_peered":"2024-04-26T23:34:46.107280+0000","last_unstale":"2024-04-27T02:38:48.929683+0000","last_undegraded":"2024-04-27T02:38:48.929683+0000","last_fullsized":"2024-04-27T02:38:48.929683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:48.929481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:48.929481+0000","last_clean_scrub_stamp":"2024-04-27T02:38:48.929481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:50:24.600842+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'3","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:44.876039+0000","last_change":"2024-04-27T02:38:44.876108+0000","last_active":"2024-04-27T02:38:44.876039+0000","last_peered":"2024-04-27T02:38:44.876039+0000","last_clean":"2024-04-27T02:38:44.876039+0000","last_became_active":"2024-04-26T23:34:45.075345+0000","last_became_peered":"2024-04-26T23:34:45.075345+0000","last_unstale":"2024-04-27T02:38:44.876039+0000","last_undegraded":"2024-04-27T02:38:44.876039+0000","last_fullsized":"2024-04-27T02:38:44.876039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-27T02:38:44.875827+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-27T02:38:44.875827+0000","last_clean_scrub_stamp":"2024-04-27T02:38:44.875827+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:21:27.862919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:52.646546+0000","last_change":"2024-04-27T02:38:52.646601+0000","last_active":"2024-04-27T02:38:52.646546+0000","last_peered":"2024-04-27T02:38:52.646546+0000","last_clean":"2024-04-27T02:38:52.646546+0000","last_became_active":"2024-04-26T23:34:46.099233+0000","last_became_peered":"2024-04-26T23:34:46.099233+0000","last_unstale":"2024-04-27T02:38:52.646546+0000","last_undegraded":"2024-04-27T02:38:52.646546+0000","last_fullsized":"2024-04-27T02:38:52.646546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:52.646337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:52.646337+0000","last_clean_scrub_stamp":"2024-04-27T02:38:52.646337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:11.536315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:44.221662+0000","last_change":"2024-04-27T02:38:44.221732+0000","last_active":"2024-04-27T02:38:44.221662+0000","last_peered":"2024-04-27T02:38:44.221662+0000","last_clean":"2024-04-27T02:38:44.221662+0000","last_became_active":"2024-04-26T23:34:45.072078+0000","last_became_peered":"2024-04-26T23:34:45.072078+0000","last_unstale":"2024-04-27T02:38:44.221662+0000","last_undegraded":"2024-04-27T02:38:44.221662+0000","last_fullsized":"2024-04-27T02:38:44.221662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-27T02:38:44.221429+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-27T02:38:44.221429+0000","last_clean_scrub_stamp":"2024-04-27T02:38:44.221429+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:50:19.892790+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.671503+0000","last_change":"2024-04-27T02:38:47.671608+0000","last_active":"2024-04-27T02:38:47.671503+0000","last_peered":"2024-04-27T02:38:47.671503+0000","last_clean":"2024-04-27T02:38:47.671503+0000","last_became_active":"2024-04-26T23:34:46.082135+0000","last_became_peered":"2024-04-26T23:34:46.082135+0000","last_unstale":"2024-04-27T02:38:47.671503+0000","last_undegraded":"2024-04-27T02:38:47.671503+0000","last_fullsized":"2024-04-27T02:38:47.671503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:47.671241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:47.671241+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.671241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:14:26.810288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"22'1","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.857016+0000","last_change":"2024-04-27T02:38:46.857077+0000","last_active":"2024-04-27T02:38:46.857016+0000","last_peered":"2024-04-27T02:38:46.857016+0000","last_clean":"2024-04-27T02:38:46.857016+0000","last_became_active":"2024-04-26T23:34:45.081049+0000","last_became_peered":"2024-04-26T23:34:45.081049+0000","last_unstale":"2024-04-27T02:38:46.857016+0000","last_undegraded":"2024-04-27T02:38:46.857016+0000","last_fullsized":"2024-04-27T02:38:46.857016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:46.856796+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:46.856796+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.856796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:43.071675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:56.496003+0000","last_change":"2024-04-27T02:38:56.496102+0000","last_active":"2024-04-27T02:38:56.496003+0000","last_peered":"2024-04-27T02:38:56.496003+0000","last_clean":"2024-04-27T02:38:56.496003+0000","last_became_active":"2024-04-26T23:34:46.097652+0000","last_became_peered":"2024-04-26T23:34:46.097652+0000","last_unstale":"2024-04-27T02:38:56.496003+0000","last_undegraded":"2024-04-27T02:38:56.496003+0000","last_fullsized":"2024-04-27T02:38:56.496003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:56.495690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:56.495690+0000","last_clean_scrub_stamp":"2024-04-27T02:38:56.495690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:42:14.475195+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'163","reported_seq":329,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:41.064822+0000","last_change":"2024-04-27T02:38:41.064854+0000","last_active":"2024-04-27T02:38:41.064822+0000","last_peered":"2024-04-27T02:38:41.064822+0000","last_clean":"2024-04-27T02:38:41.064822+0000","last_became_active":"2024-04-26T23:34:41.210694+0000","last_became_peered":"2024-04-26T23:34:41.210694+0000","last_unstale":"2024-04-27T02:38:41.064822+0000","last_undegraded":"2024-04-27T02:38:41.064822+0000","last_fullsized":"2024-04-27T02:38:41.064822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'163","last_scrub_stamp":"2024-04-27T02:38:41.064749+0000","last_deep_scrub":"22'163","last_deep_scrub_stamp":"2024-04-27T02:38:41.064749+0000","last_clean_scrub_stamp":"2024-04-27T02:38:41.064749+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:34.829414+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:48.639991+0000","last_change":"2024-04-27T02:38:48.640105+0000","last_active":"2024-04-27T02:38:48.639991+0000","last_peered":"2024-04-27T02:38:48.639991+0000","last_clean":"2024-04-27T02:38:48.639991+0000","last_became_active":"2024-04-26T23:34:45.074178+0000","last_became_peered":"2024-04-26T23:34:45.074178+0000","last_unstale":"2024-04-27T02:38:48.639991+0000","last_undegraded":"2024-04-27T02:38:48.639991+0000","last_fullsized":"2024-04-27T02:38:48.639991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:48.639767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:48.639767+0000","last_clean_scrub_stamp":"2024-04-27T02:38:48.639767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:42:48.007078+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:54.873144+0000","last_change":"2024-04-27T02:38:54.873202+0000","last_active":"2024-04-27T02:38:54.873144+0000","last_peered":"2024-04-27T02:38:54.873144+0000","last_clean":"2024-04-27T02:38:54.873144+0000","last_became_active":"2024-04-26T23:34:46.105656+0000","last_became_peered":"2024-04-26T23:34:46.105656+0000","last_unstale":"2024-04-27T02:38:54.873144+0000","last_undegraded":"2024-04-27T02:38:54.873144+0000","last_fullsized":"2024-04-27T02:38:54.873144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:54.872931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:54.872931+0000","last_clean_scrub_stamp":"2024-04-27T02:38:54.872931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:44:35.902266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":119,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:50.586559+0000","last_change":"2024-04-27T02:38:50.586633+0000","last_active":"2024-04-27T02:38:50.586559+0000","last_peered":"2024-04-27T02:38:50.586559+0000","last_clean":"2024-04-27T02:38:50.586559+0000","last_became_active":"2024-04-26T23:34:45.078040+0000","last_became_peered":"2024-04-26T23:34:45.078040+0000","last_unstale":"2024-04-27T02:38:50.586559+0000","last_undegraded":"2024-04-27T02:38:50.586559+0000","last_fullsized":"2024-04-27T02:38:50.586559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:50.586335+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:50.586335+0000","last_clean_scrub_stamp":"2024-04-27T02:38:50.586335+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:17.718048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:52.847583+0000","last_change":"2024-04-27T02:38:52.847683+0000","last_active":"2024-04-27T02:38:52.847583+0000","last_peered":"2024-04-27T02:38:52.847583+0000","last_clean":"2024-04-27T02:38:52.847583+0000","last_became_active":"2024-04-26T23:34:46.110318+0000","last_became_peered":"2024-04-26T23:34:46.110318+0000","last_unstale":"2024-04-27T02:38:52.847583+0000","last_undegraded":"2024-04-27T02:38:52.847583+0000","last_fullsized":"2024-04-27T02:38:52.847583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:52.847172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:52.847172+0000","last_clean_scrub_stamp":"2024-04-27T02:38:52.847172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:58.737630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'3","reported_seq":119,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.545801+0000","last_change":"2024-04-27T02:38:46.545876+0000","last_active":"2024-04-27T02:38:46.545801+0000","last_peered":"2024-04-27T02:38:46.545801+0000","last_clean":"2024-04-27T02:38:46.545801+0000","last_became_active":"2024-04-26T23:34:45.079434+0000","last_became_peered":"2024-04-26T23:34:45.079434+0000","last_unstale":"2024-04-27T02:38:46.545801+0000","last_undegraded":"2024-04-27T02:38:46.545801+0000","last_fullsized":"2024-04-27T02:38:46.545801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-27T02:38:46.545562+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-27T02:38:46.545562+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.545562+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:22.231614+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":1,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"22'2","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:52.172516+0000","last_change":"2024-04-27T02:38:52.172628+0000","last_active":"2024-04-27T02:38:52.172516+0000","last_peered":"2024-04-27T02:38:52.172516+0000","last_clean":"2024-04-27T02:38:52.172516+0000","last_became_active":"2024-04-26T23:34:46.104785+0000","last_became_peered":"2024-04-26T23:34:46.104785+0000","last_unstale":"2024-04-27T02:38:52.172516+0000","last_undegraded":"2024-04-27T02:38:52.172516+0000","last_fullsized":"2024-04-27T02:38:52.172516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-27T02:38:52.172219+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-27T02:38:52.172219+0000","last_clean_scrub_stamp":"2024-04-27T02:38:52.172219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:14:31.311266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:52.507917+0000","last_change":"2024-04-27T02:38:52.507970+0000","last_active":"2024-04-27T02:38:52.507917+0000","last_peered":"2024-04-27T02:38:52.507917+0000","last_clean":"2024-04-27T02:38:52.507917+0000","last_became_active":"2024-04-26T23:34:45.080787+0000","last_became_peered":"2024-04-26T23:34:45.080787+0000","last_unstale":"2024-04-27T02:38:52.507917+0000","last_undegraded":"2024-04-27T02:38:52.507917+0000","last_fullsized":"2024-04-27T02:38:52.507917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:52.507721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:52.507721+0000","last_clean_scrub_stamp":"2024-04-27T02:38:52.507721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T14:38:32.838627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:54.642438+0000","last_change":"2024-04-27T02:38:54.642548+0000","last_active":"2024-04-27T02:38:54.642438+0000","last_peered":"2024-04-27T02:38:54.642438+0000","last_clean":"2024-04-27T02:38:54.642438+0000","last_became_active":"2024-04-26T23:34:46.108334+0000","last_became_peered":"2024-04-26T23:34:46.108334+0000","last_unstale":"2024-04-27T02:38:54.642438+0000","last_undegraded":"2024-04-27T02:38:54.642438+0000","last_fullsized":"2024-04-27T02:38:54.642438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:54.642151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:54.642151+0000","last_clean_scrub_stamp":"2024-04-27T02:38:54.642151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:39.419931+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.172016+0000","last_change":"2024-04-27T02:38:47.172074+0000","last_active":"2024-04-27T02:38:47.172016+0000","last_peered":"2024-04-27T02:38:47.172016+0000","last_clean":"2024-04-27T02:38:47.172016+0000","last_became_active":"2024-04-26T23:34:45.082968+0000","last_became_peered":"2024-04-26T23:34:45.082968+0000","last_unstale":"2024-04-27T02:38:47.172016+0000","last_undegraded":"2024-04-27T02:38:47.172016+0000","last_fullsized":"2024-04-27T02:38:47.172016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:47.171787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:47.171787+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.171787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:16.538740+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'3","reported_seq":116,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:44.911014+0000","last_change":"2024-04-27T02:38:44.911076+0000","last_active":"2024-04-27T02:38:44.911014+0000","last_peered":"2024-04-27T02:38:44.911014+0000","last_clean":"2024-04-27T02:38:44.911014+0000","last_became_active":"2024-04-26T23:34:46.102948+0000","last_became_peered":"2024-04-26T23:34:46.102948+0000","last_unstale":"2024-04-27T02:38:44.911014+0000","last_undegraded":"2024-04-27T02:38:44.911014+0000","last_fullsized":"2024-04-27T02:38:44.911014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-27T02:38:44.910795+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-27T02:38:44.910795+0000","last_clean_scrub_stamp":"2024-04-27T02:38:44.910795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:13:43.391060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":115,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:54.496864+0000","last_change":"2024-04-27T02:38:54.496923+0000","last_active":"2024-04-27T02:38:54.496864+0000","last_peered":"2024-04-27T02:38:54.496864+0000","last_clean":"2024-04-27T02:38:54.496864+0000","last_became_active":"2024-04-26T23:34:45.082781+0000","last_became_peered":"2024-04-26T23:34:45.082781+0000","last_unstale":"2024-04-27T02:38:54.496864+0000","last_undegraded":"2024-04-27T02:38:54.496864+0000","last_fullsized":"2024-04-27T02:38:54.496864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:54.496663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:54.496663+0000","last_clean_scrub_stamp":"2024-04-27T02:38:54.496663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:11:09.425918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:53.885344+0000","last_change":"2024-04-27T02:38:53.885433+0000","last_active":"2024-04-27T02:38:53.885344+0000","last_peered":"2024-04-27T02:38:53.885344+0000","last_clean":"2024-04-27T02:38:53.885344+0000","last_became_active":"2024-04-26T23:34:46.114186+0000","last_became_peered":"2024-04-26T23:34:46.114186+0000","last_unstale":"2024-04-27T02:38:53.885344+0000","last_undegraded":"2024-04-27T02:38:53.885344+0000","last_fullsized":"2024-04-27T02:38:53.885344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:53.885069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:53.885069+0000","last_clean_scrub_stamp":"2024-04-27T02:38:53.885069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:45.465428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'6","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:46.926129+0000","last_change":"2024-04-27T02:38:46.926129+0000","last_active":"2024-04-27T02:38:46.926129+0000","last_peered":"2024-04-27T02:38:46.926129+0000","last_clean":"2024-04-27T02:38:46.926129+0000","last_became_active":"2024-04-26T23:34:45.080808+0000","last_became_peered":"2024-04-26T23:34:45.080808+0000","last_unstale":"2024-04-27T02:38:46.926129+0000","last_undegraded":"2024-04-27T02:38:46.926129+0000","last_fullsized":"2024-04-27T02:38:46.926129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-27T02:38:46.925744+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-27T02:38:46.925744+0000","last_clean_scrub_stamp":"2024-04-27T02:38:46.925744+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:48.119665+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":126,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'4","reported_seq":114,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:52.874470+0000","last_change":"2024-04-27T02:38:52.874470+0000","last_active":"2024-04-27T02:38:52.874470+0000","last_peered":"2024-04-27T02:38:52.874470+0000","last_clean":"2024-04-27T02:38:52.874470+0000","last_became_active":"2024-04-26T23:34:46.096965+0000","last_became_peered":"2024-04-26T23:34:46.096965+0000","last_unstale":"2024-04-27T02:38:52.874470+0000","last_undegraded":"2024-04-27T02:38:52.874470+0000","last_fullsized":"2024-04-27T02:38:52.874470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-27T02:38:52.874170+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-27T02:38:52.874170+0000","last_clean_scrub_stamp":"2024-04-27T02:38:52.874170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:16.902516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":116,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:51.555499+0000","last_change":"2024-04-27T02:38:51.555499+0000","last_active":"2024-04-27T02:38:51.555499+0000","last_peered":"2024-04-27T02:38:51.555499+0000","last_clean":"2024-04-27T02:38:51.555499+0000","last_became_active":"2024-04-26T23:34:45.077939+0000","last_became_peered":"2024-04-26T23:34:45.077939+0000","last_unstale":"2024-04-27T02:38:51.555499+0000","last_undegraded":"2024-04-27T02:38:51.555499+0000","last_fullsized":"2024-04-27T02:38:51.555499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-27T02:38:51.555242+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-27T02:38:51.555242+0000","last_clean_scrub_stamp":"2024-04-27T02:38:51.555242+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:10.445220+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:48.865901+0000","last_change":"2024-04-27T02:38:48.865901+0000","last_active":"2024-04-27T02:38:48.865901+0000","last_peered":"2024-04-27T02:38:48.865901+0000","last_clean":"2024-04-27T02:38:48.865901+0000","last_became_active":"2024-04-26T23:34:46.077535+0000","last_became_peered":"2024-04-26T23:34:46.077535+0000","last_unstale":"2024-04-27T02:38:48.865901+0000","last_undegraded":"2024-04-27T02:38:48.865901+0000","last_fullsized":"2024-04-27T02:38:48.865901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:48.865636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:48.865636+0000","last_clean_scrub_stamp":"2024-04-27T02:38:48.865636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:09:10.326052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"22'1","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:43.691949+0000","last_change":"2024-04-27T02:38:43.691949+0000","last_active":"2024-04-27T02:38:43.691949+0000","last_peered":"2024-04-27T02:38:43.691949+0000","last_clean":"2024-04-27T02:38:43.691949+0000","last_became_active":"2024-04-26T23:34:45.075767+0000","last_became_peered":"2024-04-26T23:34:45.075767+0000","last_unstale":"2024-04-27T02:38:43.691949+0000","last_undegraded":"2024-04-27T02:38:43.691949+0000","last_fullsized":"2024-04-27T02:38:43.691949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:43.691686+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:43.691686+0000","last_clean_scrub_stamp":"2024-04-27T02:38:43.691686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:49.582144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.680458+0000","last_change":"2024-04-27T02:38:42.680458+0000","last_active":"2024-04-27T02:38:42.680458+0000","last_peered":"2024-04-27T02:38:42.680458+0000","last_clean":"2024-04-27T02:38:42.680458+0000","last_became_active":"2024-04-26T23:34:46.092235+0000","last_became_peered":"2024-04-26T23:34:46.092235+0000","last_unstale":"2024-04-27T02:38:42.680458+0000","last_undegraded":"2024-04-27T02:38:42.680458+0000","last_fullsized":"2024-04-27T02:38:42.680458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:42.680346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:42.680346+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.680346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:48.570804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.872812+0000","last_change":"2024-04-27T02:38:45.872812+0000","last_active":"2024-04-27T02:38:45.872812+0000","last_peered":"2024-04-27T02:38:45.872812+0000","last_clean":"2024-04-27T02:38:45.872812+0000","last_became_active":"2024-04-26T23:34:45.079401+0000","last_became_peered":"2024-04-26T23:34:45.079401+0000","last_unstale":"2024-04-27T02:38:45.872812+0000","last_undegraded":"2024-04-27T02:38:45.872812+0000","last_fullsized":"2024-04-27T02:38:45.872812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:45.872553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:45.872553+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.872553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:51:52.397902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:49.867481+0000","last_change":"2024-04-27T02:38:49.867481+0000","last_active":"2024-04-27T02:38:49.867481+0000","last_peered":"2024-04-27T02:38:49.867481+0000","last_clean":"2024-04-27T02:38:49.867481+0000","last_became_active":"2024-04-26T23:34:46.083649+0000","last_became_peered":"2024-04-26T23:34:46.083649+0000","last_unstale":"2024-04-27T02:38:49.867481+0000","last_undegraded":"2024-04-27T02:38:49.867481+0000","last_fullsized":"2024-04-27T02:38:49.867481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:49.867179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:49.867179+0000","last_clean_scrub_stamp":"2024-04-27T02:38:49.867179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:43:32.605609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:44.924470+0000","last_change":"2024-04-27T02:38:44.924540+0000","last_active":"2024-04-27T02:38:44.924470+0000","last_peered":"2024-04-27T02:38:44.924470+0000","last_clean":"2024-04-27T02:38:44.924470+0000","last_became_active":"2024-04-26T23:34:45.079205+0000","last_became_peered":"2024-04-26T23:34:45.079205+0000","last_unstale":"2024-04-27T02:38:44.924470+0000","last_undegraded":"2024-04-27T02:38:44.924470+0000","last_fullsized":"2024-04-27T02:38:44.924470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-27T02:38:44.924166+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-27T02:38:44.924166+0000","last_clean_scrub_stamp":"2024-04-27T02:38:44.924166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:40:56.986909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:49.540025+0000","last_change":"2024-04-27T02:38:49.540082+0000","last_active":"2024-04-27T02:38:49.540025+0000","last_peered":"2024-04-27T02:38:49.540025+0000","last_clean":"2024-04-27T02:38:49.540025+0000","last_became_active":"2024-04-26T23:34:46.098786+0000","last_became_peered":"2024-04-26T23:34:46.098786+0000","last_unstale":"2024-04-27T02:38:49.540025+0000","last_undegraded":"2024-04-27T02:38:49.540025+0000","last_fullsized":"2024-04-27T02:38:49.540025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:49.539815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:49.539815+0000","last_clean_scrub_stamp":"2024-04-27T02:38:49.539815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:50:44.694752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:49.602996+0000","last_change":"2024-04-27T02:38:49.603154+0000","last_active":"2024-04-27T02:38:49.602996+0000","last_peered":"2024-04-27T02:38:49.602996+0000","last_clean":"2024-04-27T02:38:49.602996+0000","last_became_active":"2024-04-26T23:34:45.076482+0000","last_became_peered":"2024-04-26T23:34:45.076482+0000","last_unstale":"2024-04-27T02:38:49.602996+0000","last_undegraded":"2024-04-27T02:38:49.602996+0000","last_fullsized":"2024-04-27T02:38:49.602996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-27T02:38:49.602760+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-27T02:38:49.602760+0000","last_clean_scrub_stamp":"2024-04-27T02:38:49.602760+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:47:45.184931+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:55.532829+0000","last_change":"2024-04-27T02:38:55.532882+0000","last_active":"2024-04-27T02:38:55.532829+0000","last_peered":"2024-04-27T02:38:55.532829+0000","last_clean":"2024-04-27T02:38:55.532829+0000","last_became_active":"2024-04-26T23:34:46.096700+0000","last_became_peered":"2024-04-26T23:34:46.096700+0000","last_unstale":"2024-04-27T02:38:55.532829+0000","last_undegraded":"2024-04-27T02:38:55.532829+0000","last_fullsized":"2024-04-27T02:38:55.532829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:55.532629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:55.532629+0000","last_clean_scrub_stamp":"2024-04-27T02:38:55.532629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:20.422425+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:57.509306+0000","last_change":"2024-04-27T02:38:57.509360+0000","last_active":"2024-04-27T02:38:57.509306+0000","last_peered":"2024-04-27T02:38:57.509306+0000","last_clean":"2024-04-27T02:38:57.509306+0000","last_became_active":"2024-04-26T23:34:46.095314+0000","last_became_peered":"2024-04-26T23:34:46.095314+0000","last_unstale":"2024-04-27T02:38:57.509306+0000","last_undegraded":"2024-04-27T02:38:57.509306+0000","last_fullsized":"2024-04-27T02:38:57.509306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:57.509065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:57.509065+0000","last_clean_scrub_stamp":"2024-04-27T02:38:57.509065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:39:09.909117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:42.733151+0000","last_change":"2024-04-27T02:38:42.733199+0000","last_active":"2024-04-27T02:38:42.733151+0000","last_peered":"2024-04-27T02:38:42.733151+0000","last_clean":"2024-04-27T02:38:42.733151+0000","last_became_active":"2024-04-26T23:34:45.074255+0000","last_became_peered":"2024-04-26T23:34:45.074255+0000","last_unstale":"2024-04-27T02:38:42.733151+0000","last_undegraded":"2024-04-27T02:38:42.733151+0000","last_fullsized":"2024-04-27T02:38:42.733151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-27T02:38:42.733007+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-27T02:38:42.733007+0000","last_clean_scrub_stamp":"2024-04-27T02:38:42.733007+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:43:25.471437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.108607+0000","last_change":"2024-04-27T02:38:45.108649+0000","last_active":"2024-04-27T02:38:45.108607+0000","last_peered":"2024-04-27T02:38:45.108607+0000","last_clean":"2024-04-27T02:38:45.108607+0000","last_became_active":"2024-04-26T23:34:46.100098+0000","last_became_peered":"2024-04-26T23:34:46.100098+0000","last_unstale":"2024-04-27T02:38:45.108607+0000","last_undegraded":"2024-04-27T02:38:45.108607+0000","last_fullsized":"2024-04-27T02:38:45.108607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:45.108487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:45.108487+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.108487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:50:40.263424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":104,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:41.706415+0000","last_change":"2024-04-27T02:38:41.706468+0000","last_active":"2024-04-27T02:38:41.706415+0000","last_peered":"2024-04-27T02:38:41.706415+0000","last_clean":"2024-04-27T02:38:41.706415+0000","last_became_active":"2024-04-26T23:34:45.073152+0000","last_became_peered":"2024-04-26T23:34:45.073152+0000","last_unstale":"2024-04-27T02:38:41.706415+0000","last_undegraded":"2024-04-27T02:38:41.706415+0000","last_fullsized":"2024-04-27T02:38:41.706415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-27T02:38:41.706259+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-27T02:38:41.706259+0000","last_clean_scrub_stamp":"2024-04-27T02:38:41.706259+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T12:03:56.898237+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":113,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:56.229473+0000","last_change":"2024-04-27T02:38:56.229527+0000","last_active":"2024-04-27T02:38:56.229473+0000","last_peered":"2024-04-27T02:38:56.229473+0000","last_clean":"2024-04-27T02:38:56.229473+0000","last_became_active":"2024-04-26T23:34:46.107806+0000","last_became_peered":"2024-04-26T23:34:46.107806+0000","last_unstale":"2024-04-27T02:38:56.229473+0000","last_undegraded":"2024-04-27T02:38:56.229473+0000","last_fullsized":"2024-04-27T02:38:56.229473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:56.229200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:56.229200+0000","last_clean_scrub_stamp":"2024-04-27T02:38:56.229200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:23.360913+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":120,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:45.210553+0000","last_change":"2024-04-27T02:38:45.210677+0000","last_active":"2024-04-27T02:38:45.210553+0000","last_peered":"2024-04-27T02:38:45.210553+0000","last_clean":"2024-04-27T02:38:45.210553+0000","last_became_active":"2024-04-26T23:34:45.079029+0000","last_became_peered":"2024-04-26T23:34:45.079029+0000","last_unstale":"2024-04-27T02:38:45.210553+0000","last_undegraded":"2024-04-27T02:38:45.210553+0000","last_fullsized":"2024-04-27T02:38:45.210553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-27T02:38:45.210222+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-27T02:38:45.210222+0000","last_clean_scrub_stamp":"2024-04-27T02:38:45.210222+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:06.651150+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":116,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:50.162234+0000","last_change":"2024-04-27T02:38:50.162288+0000","last_active":"2024-04-27T02:38:50.162234+0000","last_peered":"2024-04-27T02:38:50.162234+0000","last_clean":"2024-04-27T02:38:50.162234+0000","last_became_active":"2024-04-26T23:34:46.103462+0000","last_became_peered":"2024-04-26T23:34:46.103462+0000","last_unstale":"2024-04-27T02:38:50.162234+0000","last_undegraded":"2024-04-27T02:38:50.162234+0000","last_fullsized":"2024-04-27T02:38:50.162234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T02:38:50.162031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T02:38:50.162031+0000","last_clean_scrub_stamp":"2024-04-27T02:38:50.162031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:51.053635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'7","reported_seq":122,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-27T02:38:47.886935+0000","last_change":"2024-04-27T02:38:47.887010+0000","last_active":"2024-04-27T02:38:47.886935+0000","last_peered":"2024-04-27T02:38:47.886935+0000","last_clean":"2024-04-27T02:38:47.886935+0000","last_became_active":"2024-04-26T23:34:45.083146+0000","last_became_peered":"2024-04-26T23:34:45.083146+0000","last_unstale":"2024-04-27T02:38:47.886935+0000","last_undegraded":"2024-04-27T02:38:47.886935+0000","last_fullsized":"2024-04-27T02:38:47.886935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-04-27T02:38:47.886693+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-04-27T02:38:47.886693+0000","last_clean_scrub_stamp":"2024-04-27T02:38:47.886693+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:06:32.622872+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":202439,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":3,"num_write":102,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5126,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":404878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834577064,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":241664,"data_stored":85395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834577063,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":229376,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834577063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":839680,"data_stored":675739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834577063,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":446464,"data_stored":282736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834577063,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":83437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834577063,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":438272,"data_stored":282064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834577063,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":827392,"data_stored":673285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834577063,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":82903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":199217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":199889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":8,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-27T02:39:06.196 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-27T02:39:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.462+0000 7f1837200640 1 Processor -- start 2024-04-27T02:39:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.463+0000 7f1837200640 1 -- start start 2024-04-27T02:39:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.464+0000 7f1837200640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18380b6940 0x7f18381498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.464+0000 7f1837200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 0x7f1838149e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.464+0000 7f1837200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18380718e0 con 0x7f183813ff40 2024-04-27T02:39:06.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.464+0000 7f1837200640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f18380b3af0 con 0x7f18380b6940 2024-04-27T02:39:06.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.464+0000 7f1837200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f1838070680 con 0x7f18380b5640 2024-04-27T02:39:06.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.464+0000 7f1836800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f183813ff40 0x7f18381403b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41318/0 (socket says 172.21.15.16:41318) 2024-04-27T02:39:06.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.464+0000 7f1836800640 1 -- 172.21.15.16:0/1026461394 learned_addr learned my addr 172.21.15.16:0/1026461394 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:39:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1835400640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 0x7f1838149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1835e00640 1 --2- 172.21.15.16:0/1026461394 >> v2:172.21.15.32:3300/0 conn(0x7f18380b6940 0x7f18381498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306524797 0 0) 0x7f18380718e0 con 0x7f183813ff40 2024-04-27T02:39:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f181c003520 con 0x7f183813ff40 2024-04-27T02:39:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2418553413 0 0) 0x7f181c003520 con 0x7f183813ff40 2024-04-27T02:39:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 msgr2=0x7f1838149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 0x7f1838149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 >> v2:172.21.15.32:3300/0 conn(0x7f18380b6940 msgr2=0x7f18381498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 --2- 172.21.15.16:0/1026461394 >> v2:172.21.15.32:3300/0 conn(0x7f18380b6940 0x7f18381498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18380b6d20 con 0x7f183813ff40 2024-04-27T02:39:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f18300019f0 con 0x7f183813ff40 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 >> v1:172.21.15.16:6789/0 conn(0x7f183813ff40 legacy=0x7f18381403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f181c0039b0 0x7f181c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f181c004800 0x7f181c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 0x7f181c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.465+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18380b3af0 con 0x7f181c004800 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f1838070680 con 0x7f181c0039b0 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f181c00ba40 con 0x7f18380b5640 2024-04-27T02:39:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1835400640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f181c004800 0x7f181c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1835e00640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f181c0039b0 0x7f181c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1836800640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 0x7f181c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1835400640 1 -- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 msgr2=0x7f181c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1835400640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f18380b5640 0x7f181c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1835400640 1 -- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f181c0039b0 msgr2=0x7f181c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1835400640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f181c0039b0 0x7f181c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.466+0000 7f1835400640 1 -- 172.21.15.16:0/1026461394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c003520 con 0x7f181c004800 2024-04-27T02:39:06.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.467+0000 7f1835400640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f181c004800 0x7f181c004c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1824009ac0 tx=0x7f181c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282bb40379c08004 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:06.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824036070 con 0x7f181c004800 2024-04-27T02:39:06.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1824031400 con 0x7f181c004800 2024-04-27T02:39:06.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1834a00640 1 -- 172.21.15.16:0/1026461394 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824009690 con 0x7f181c004800 2024-04-27T02:39:06.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1837200640 1 -- 172.21.15.16:0/1026461394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f181c004800 msgr2=0x7f181c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1837200640 1 --2- 172.21.15.16:0/1026461394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f181c004800 0x7f181c004c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1824009ac0 tx=0x7f181c005830 comp rx=0 tx=0).stop 2024-04-27T02:39:06.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1836800640 1 -- 172.21.15.16:0/1026461394 reap_dead start 2024-04-27T02:39:06.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1837200640 1 -- 172.21.15.16:0/1026461394 shutdown_connections 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.468+0000 7f1837200640 1 -- 172.21.15.16:0/1026461394 >> 172.21.15.16:0/1026461394 conn(0x7f1838068270 msgr2=0x7f1838068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.469+0000 7f1837200640 1 -- 172.21.15.16:0/1026461394 shutdown_connections 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.469+0000 7f1837200640 1 -- 172.21.15.16:0/1026461394 wait complete. 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.470+0000 7f1837200640 1 Processor -- start 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.470+0000 7f1837200640 1 -- start start 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1837200640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f181c004800 0x7f18381e1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1837200640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18380b9bf0 0x7f183813c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1837200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18380b8370 0x7f18380b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1837200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18380b3710 con 0x7f18380b8370 2024-04-27T02:39:06.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1837200640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f18380b3d10 con 0x7f18380b9bf0 2024-04-27T02:39:06.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1837200640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f18380b3890 con 0x7f181c004800 2024-04-27T02:39:06.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1836800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18380b8370 0x7f18380b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1836800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18380b8370 0x7f18380b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45838/0 (socket says 172.21.15.16:45838) 2024-04-27T02:39:06.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.471+0000 7f1836800640 1 -- 172.21.15.16:0/1670913499 learned_addr learned my addr 172.21.15.16:0/1670913499 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:06.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1836800640 1 -- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f181c004800 msgr2=0x7f18381e1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1836800640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f181c004800 0x7f18381e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1836800640 1 -- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18380b9bf0 msgr2=0x7f183813c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1835400640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18380b9bf0 0x7f183813c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1836800640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18380b9bf0 0x7f183813c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1836800640 1 -- 172.21.15.16:0/1670913499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18380b8d20 con 0x7f18380b8370 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1836800640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18380b8370 0x7f18380b87e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18380b7840 tx=0x7f183000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183000ec10 con 0x7f18380b8370 2024-04-27T02:39:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183000edb0 con 0x7f18380b8370 2024-04-27T02:39:06.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830014670 con 0x7f18380b8370 2024-04-27T02:39:06.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.472+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18381e1d90 con 0x7f18380b8370 2024-04-27T02:39:06.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.473+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18381e2030 con 0x7f18380b8370 2024-04-27T02:39:06.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.474+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18380712b0 con 0x7f18380b8370 2024-04-27T02:39:06.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.475+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1830014810 con 0x7f18380b8370 2024-04-27T02:39:06.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.476+0000 7f182e000640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f181806c8f0 0x7f181806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.476+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f183008b960 con 0x7f18380b8370 2024-04-27T02:39:06.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.477+0000 7f1835e00640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f181806c8f0 0x7f181806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.478+0000 7f1835e00640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f181806c8f0 0x7f181806edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1828009990 tx=0x7f1828008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:06.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.481+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f18380712b0 con 0x7f18380b8370 2024-04-27T02:39:06.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.688+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f18380b4080 con 0x7f18380b8370 2024-04-27T02:39:06.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.696+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f18380b4080 con 0x7f18380b8370 2024-04-27T02:39:06.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.698+0000 7f182e000640 1 -- 172.21.15.16:0/1670913499 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1830091080 con 0x7f18380b8370 2024-04-27T02:39:06.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f181806c8f0 msgr2=0x7f181806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f181806c8f0 0x7f181806edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1828009990 tx=0x7f1828008040 comp rx=0 tx=0).stop 2024-04-27T02:39:06.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18380b8370 msgr2=0x7f18380b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18380b8370 0x7f18380b87e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18380b7840 tx=0x7f183000e530 comp rx=0 tx=0).stop 2024-04-27T02:39:06.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 shutdown_connections 2024-04-27T02:39:06.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f181806c8f0 0x7f181806edb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18380b9bf0 0x7f183813c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18380b8370 0x7f18380b87e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 --2- 172.21.15.16:0/1670913499 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f181c004800 0x7f18381e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 >> 172.21.15.16:0/1670913499 conn(0x7f1838068270 msgr2=0x7f1838145220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:06.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 shutdown_connections 2024-04-27T02:39:06.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.700+0000 7f1837200640 1 -- 172.21.15.16:0/1670913499 wait complete. 2024-04-27T02:39:06.695 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-27T02:39:06.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-27T02:39:06.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.928+0000 7f03f5e00640 1 Processor -- start 2024-04-27T02:39:06.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.929+0000 7f03f5e00640 1 -- start start 2024-04-27T02:39:06.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.930+0000 7f03f5e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f03f00bd7a0 0x7f03f0148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.930+0000 7f03f5e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f0073420 0x7f03f0073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.930+0000 7f03f5e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03f00bc010 con 0x7f03f00bbc30 2024-04-27T02:39:06.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.930+0000 7f03f5e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f03f0149220 con 0x7f03f00bd7a0 2024-04-27T02:39:06.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.930+0000 7f03f5e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f03f0148220 con 0x7f03f0073420 2024-04-27T02:39:06.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.931+0000 7f03f5400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f0073420 0x7f03f0073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.931+0000 7f03f5400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f0073420 0x7f03f0073cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3301/0 says I am v2:172.21.15.16:58150/0 (socket says 172.21.15.16:58150) 2024-04-27T02:39:06.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.931+0000 7f03f5400640 1 -- 172.21.15.16:0/3940647764 learned_addr learned my addr 172.21.15.16:0/3940647764 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:06.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.931+0000 7f03efe00640 1 --2- 172.21.15.16:0/3940647764 >> v2:172.21.15.32:3300/0 conn(0x7f03f00bd7a0 0x7f03f0148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.932+0000 7f03f5400640 1 -- 172.21.15.16:0/3940647764 >> v2:172.21.15.32:3300/0 conn(0x7f03f00bd7a0 msgr2=0x7f03f0148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:06.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.932+0000 7f03f5400640 1 --2- 172.21.15.16:0/3940647764 >> v2:172.21.15.32:3300/0 conn(0x7f03f00bd7a0 0x7f03f0148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.932+0000 7f03ef400640 1 -- 172.21.15.16:0/3940647764 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159351007 0 0) 0x7f03f00bc010 con 0x7f03f00bbc30 2024-04-27T02:39:06.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.932+0000 7f03f5400640 1 -- 172.21.15.16:0/3940647764 >> v1:172.21.15.32:6789/0 conn(0x7f03f00bbc30 legacy=0x7f03f00baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.932+0000 7f03f5400640 1 -- 172.21.15.16:0/3940647764 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f01484e0 con 0x7f03f0073420 2024-04-27T02:39:06.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.933+0000 7f03f5400640 1 --2- 172.21.15.16:0/3940647764 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f0073420 0x7f03f0073cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009870 tx=0x7f03e802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78e35923487eb43 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:06.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03ef400640 1 -- 172.21.15.16:0/3940647764 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8037070 con 0x7f03f0073420 2024-04-27T02:39:06.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03ef400640 1 -- 172.21.15.16:0/3940647764 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f03e8032440 con 0x7f03f0073420 2024-04-27T02:39:06.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03ef400640 1 -- 172.21.15.16:0/3940647764 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8032830 con 0x7f03f0073420 2024-04-27T02:39:06.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03f5e00640 1 -- 172.21.15.16:0/3940647764 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f0073420 msgr2=0x7f03f0073cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03f5e00640 1 --2- 172.21.15.16:0/3940647764 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f0073420 0x7f03f0073cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009870 tx=0x7f03e802a130 comp rx=0 tx=0).stop 2024-04-27T02:39:06.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03f5e00640 1 -- 172.21.15.16:0/3940647764 shutdown_connections 2024-04-27T02:39:06.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03f5e00640 1 --2- 172.21.15.16:0/3940647764 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f0073420 0x7f03f0073cf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03f5e00640 1 --2- 172.21.15.16:0/3940647764 >> v2:172.21.15.32:3300/0 conn(0x7f03f00bd7a0 0x7f03f0148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.934+0000 7f03f5e00640 1 -- 172.21.15.16:0/3940647764 >> 172.21.15.16:0/3940647764 conn(0x7f03f009fc60 msgr2=0x7f03f00a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:06.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.935+0000 7f03f5e00640 1 -- 172.21.15.16:0/3940647764 shutdown_connections 2024-04-27T02:39:06.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.935+0000 7f03f5e00640 1 -- 172.21.15.16:0/3940647764 wait complete. 2024-04-27T02:39:06.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.937+0000 7f03f5e00640 1 Processor -- start 2024-04-27T02:39:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.937+0000 7f03f5e00640 1 -- start start 2024-04-27T02:39:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03f5e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03f0073420 0x7f03f0143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03f5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00bbc30 0x7f03f00a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03f5e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f00bd7a0 0x7f03f0141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03f5e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f03f00743b0 con 0x7f03f00bbc30 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03f5e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0074230 con 0x7f03f0073420 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03f5e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f03f0074530 con 0x7f03f00bd7a0 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03efe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00bbc30 0x7f03f00a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03efe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00bbc30 0x7f03f00a3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36590/0 (socket says 172.21.15.16:36590) 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.938+0000 7f03efe00640 1 -- 172.21.15.16:0/134644470 learned_addr learned my addr 172.21.15.16:0/134644470 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03f5400640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f00bd7a0 0x7f03f0141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03f4a00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03f0073420 0x7f03f0143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03efe00640 1 -- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f00bd7a0 msgr2=0x7f03f0141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03efe00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f00bd7a0 0x7f03f0141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03efe00640 1 -- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03f0073420 msgr2=0x7f03f0143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03efe00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03f0073420 0x7f03f0143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03efe00640 1 -- 172.21.15.16:0/134644470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f00b7ec0 con 0x7f03f00bbc30 2024-04-27T02:39:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03efe00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00bbc30 0x7f03f00a3350 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e870 tx=0x7f03d800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03ecc00640 1 -- 172.21.15.16:0/134644470 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8017070 con 0x7f03f00bbc30 2024-04-27T02:39:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03ecc00640 1 -- 172.21.15.16:0/134644470 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f03d800c8e0 con 0x7f03f00bbc30 2024-04-27T02:39:06.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f0145030 con 0x7f03f00bbc30 2024-04-27T02:39:06.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.939+0000 7f03ecc00640 1 -- 172.21.15.16:0/134644470 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800ccd0 con 0x7f03f00bbc30 2024-04-27T02:39:06.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.940+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f0142fd0 con 0x7f03f00bbc30 2024-04-27T02:39:06.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.941+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f0143230 con 0x7f03f00bbc30 2024-04-27T02:39:06.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.942+0000 7f03ecc00640 1 -- 172.21.15.16:0/134644470 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03d801a070 con 0x7f03f00bbc30 2024-04-27T02:39:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.943+0000 7f03ecc00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f03cc06c8f0 0x7f03cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.943+0000 7f03ecc00640 1 -- 172.21.15.16:0/134644470 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f03d808be90 con 0x7f03f00bbc30 2024-04-27T02:39:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.943+0000 7f03f4a00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f03cc06c8f0 0x7f03cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.944+0000 7f03f4a00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f03cc06c8f0 0x7f03cc06edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f03e00012e0 tx=0x7f03e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:06.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:06.947+0000 7f03ecc00640 1 -- 172.21.15.16:0/134644470 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f03d805a180 con 0x7f03f00bbc30 2024-04-27T02:39:07.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.200+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03f00bcf30 con 0x7f03f00bbc30 2024-04-27T02:39:07.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.201+0000 7f03ecc00640 1 -- 172.21.15.16:0/134644470 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7f03d8059a80 con 0x7f03f00bbc30 2024-04-27T02:39:07.175 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:39:07.175 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:34:45.529018+0000","modified":"2024-04-26T23:34:48.591854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1571792382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1571792382},{"type":"v1","addr":"172.21.15.32:6835","nonce":1571792382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-27T02:39:07.175 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-27T02:39:07.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f03cc06c8f0 msgr2=0x7f03cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f03cc06c8f0 0x7f03cc06edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f03e00012e0 tx=0x7f03e0009040 comp rx=0 tx=0).stop 2024-04-27T02:39:07.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00bbc30 msgr2=0x7f03f00a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00bbc30 0x7f03f00a3350 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e870 tx=0x7f03d800ed30 comp rx=0 tx=0).stop 2024-04-27T02:39:07.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 shutdown_connections 2024-04-27T02:39:07.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f03cc06c8f0 0x7f03cc06edb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f03f00bd7a0 0x7f03f0141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00bbc30 0x7f03f00a3350 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 --2- 172.21.15.16:0/134644470 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03f0073420 0x7f03f0143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.203+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 >> 172.21.15.16:0/134644470 conn(0x7f03f009fc60 msgr2=0x7f03f00b9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:07.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.204+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 shutdown_connections 2024-04-27T02:39:07.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.204+0000 7f03f5e00640 1 -- 172.21.15.16:0/134644470 wait complete. 2024-04-27T02:39:07.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-27T02:39:07.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.434+0000 7f5739e00640 1 Processor -- start 2024-04-27T02:39:07.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.435+0000 7f5739e00640 1 -- start start 2024-04-27T02:39:07.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.436+0000 7f5739e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f57340bd7a0 0x7f5734148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.436+0000 7f5739e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57340bc010 con 0x7f5734073420 2024-04-27T02:39:07.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.436+0000 7f5739e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5734148220 con 0x7f57340bbc30 2024-04-27T02:39:07.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.436+0000 7f5739e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f5734149220 con 0x7f57340bd7a0 2024-04-27T02:39:07.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.437+0000 7f5739400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5734073420 0x7f5734073cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53560/0 (socket says 172.21.15.16:53560) 2024-04-27T02:39:07.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.437+0000 7f5739400640 1 -- 172.21.15.16:0/2982495046 learned_addr learned my addr 172.21.15.16:0/2982495046 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:39:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.437+0000 7f572be00640 1 --2- 172.21.15.16:0/2982495046 >> v2:172.21.15.32:3300/0 conn(0x7f57340bd7a0 0x7f5734148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.437+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327296388 0 0) 0x7f57340bc010 con 0x7f5734073420 2024-04-27T02:39:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.437+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5718003520 con 0x7f5734073420 2024-04-27T02:39:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551542244 0 0) 0x7f5734148220 con 0x7f57340bbc30 2024-04-27T02:39:07.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57340bc010 con 0x7f57340bbc30 2024-04-27T02:39:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4211678261 0 0) 0x7f5718003520 con 0x7f5734073420 2024-04-27T02:39:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 >> v2:172.21.15.32:3300/0 conn(0x7f57340bd7a0 msgr2=0x7f5734148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 --2- 172.21.15.16:0/2982495046 >> v2:172.21.15.32:3300/0 conn(0x7f57340bd7a0 0x7f5734148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 >> v1:172.21.15.32:6789/0 conn(0x7f57340bbc30 legacy=0x7f57340baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57341484e0 con 0x7f5734073420 2024-04-27T02:39:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f572c001a10 con 0x7f5734073420 2024-04-27T02:39:07.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 >> v1:172.21.15.16:6789/0 conn(0x7f5734073420 legacy=0x7f5734073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5718003b90 0x7f5718003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718004800 0x7f5718004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5718005280 0x7f571800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5734149220 con 0x7f5718003b90 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f571800c1c0 con 0x7f5718005280 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f571800c3c0 con 0x7f5718004800 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f572be00640 1 --2- 172.21.15.16:0/2982495046 >> v2:172.21.15.32:3300/0 conn(0x7f57340bd7a0 0x7f5734148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T02:39:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.438+0000 7f5738a00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5718003b90 0x7f5718003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.439+0000 7f5738a00640 1 -- 172.21.15.16:0/2982495046 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718004800 msgr2=0x7f5718004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.439+0000 7f5738a00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718004800 0x7f5718004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.439+0000 7f5739400640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5718005280 0x7f571800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.439+0000 7f5738a00640 1 -- 172.21.15.16:0/2982495046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5718005280 msgr2=0x7f571800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.439+0000 7f5738a00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5718005280 0x7f571800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.439+0000 7f5738a00640 1 -- 172.21.15.16:0/2982495046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5718003520 con 0x7f5718003b90 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.439+0000 7f5739400640 1 -- 172.21.15.16:0/2982495046 reap_dead start 2024-04-27T02:39:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.440+0000 7f5738a00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5718003b90 0x7f5718003f90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57240018c0 tx=0x7f5718005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2023c6a718ff858a server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:07.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.440+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240014e0 con 0x7f5718003b90 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.440+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f57240052f0 con 0x7f5718003b90 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.440+0000 7f5733e00640 1 -- 172.21.15.16:0/2982495046 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572402aca0 con 0x7f5718003b90 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.441+0000 7f5739e00640 1 -- 172.21.15.16:0/2982495046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5718003b90 msgr2=0x7f5718003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.441+0000 7f5739e00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5718003b90 0x7f5718003f90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57240018c0 tx=0x7f5718005830 comp rx=0 tx=0).stop 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.441+0000 7f5739e00640 1 -- 172.21.15.16:0/2982495046 shutdown_connections 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.441+0000 7f5739e00640 1 --2- 172.21.15.16:0/2982495046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5718003b90 0x7f5718003f90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.441+0000 7f5739e00640 1 -- 172.21.15.16:0/2982495046 >> 172.21.15.16:0/2982495046 conn(0x7f573409fc60 msgr2=0x7f57340a0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.441+0000 7f5739e00640 1 -- 172.21.15.16:0/2982495046 shutdown_connections 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.441+0000 7f5739e00640 1 -- 172.21.15.16:0/2982495046 wait complete. 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.442+0000 7f5739e00640 1 Processor -- start 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.443+0000 7f5739e00640 1 -- start start 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.443+0000 7f5739e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718003b90 0x7f57340b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.443+0000 7f5739e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5734144b40 0x7f5734141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.443+0000 7f5739e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5734144fa0 0x7f57341422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.443+0000 7f5739e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5734148e60 con 0x7f5734144b40 2024-04-27T02:39:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.443+0000 7f5739e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f5734148ce0 con 0x7f5734144fa0 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.443+0000 7f5739e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f5734148fe0 con 0x7f5718003b90 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5734144b40 0x7f5734141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5734144b40 0x7f5734141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36610/0 (socket says 172.21.15.16:36610) 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 -- 172.21.15.16:0/1405740336 learned_addr learned my addr 172.21.15.16:0/1405740336 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f5738a00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718003b90 0x7f57340b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 -- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718003b90 msgr2=0x7f57340b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718003b90 0x7f57340b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 -- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5734144fa0 msgr2=0x7f57341422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5734144fa0 0x7f57341422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 -- 172.21.15.16:0/1405740336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57340a0c40 con 0x7f5734144b40 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.444+0000 7f572be00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5734144b40 0x7f5734141da0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f571c00eb30 tx=0x7f571c009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.445+0000 7f5731600640 1 -- 172.21.15.16:0/1405740336 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c017070 con 0x7f5734144b40 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.445+0000 7f5731600640 1 -- 172.21.15.16:0/1405740336 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f571c00ca00 con 0x7f5734144b40 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.445+0000 7f5731600640 1 -- 172.21.15.16:0/1405740336 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c00cdf0 con 0x7f5734144b40 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.445+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57340a0f20 con 0x7f5734144b40 2024-04-27T02:39:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.445+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5734142820 con 0x7f5734144b40 2024-04-27T02:39:07.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.446+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5734076600 con 0x7f5734144b40 2024-04-27T02:39:07.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.447+0000 7f5731600640 1 -- 172.21.15.16:0/1405740336 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f571c01a070 con 0x7f5734144b40 2024-04-27T02:39:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.449+0000 7f5731600640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f571006c8f0 0x7f571006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.449+0000 7f5731600640 1 -- 172.21.15.16:0/1405740336 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f571c08bfe0 con 0x7f5734144b40 2024-04-27T02:39:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.449+0000 7f5738a00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f571006c8f0 0x7f571006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.450+0000 7f5738a00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f571006c8f0 0x7f571006edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5724032000 tx=0x7f572402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:07.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.453+0000 7f5731600640 1 -- 172.21.15.16:0/1405740336 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f571c05a420 con 0x7f5734144b40 2024-04-27T02:39:07.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.698+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5734148220 con 0x7f5734144b40 2024-04-27T02:39:07.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.700+0000 7f5731600640 1 -- 172.21.15.16:0/1405740336 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7f571c059d20 con 0x7f5734144b40 2024-04-27T02:39:07.674 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:39:07.674 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1725393259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1725393259},{"type":"v1","addr":"172.21.15.16:6833","nonce":1725393259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:34:45.529018+0000","modified":"2024-04-26T23:34:48.591854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.32:6835/1571792382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1571792382},{"type":"v1","addr":"172.21.15.32:6835","nonce":1571792382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4273,"qdb_cluster":[4273]},"id":1}]} 2024-04-27T02:39:07.675 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-27T02:39:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f571006c8f0 msgr2=0x7f571006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f571006c8f0 0x7f571006edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5724032000 tx=0x7f572402e000 comp rx=0 tx=0).stop 2024-04-27T02:39:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5734144b40 msgr2=0x7f5734141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5734144b40 0x7f5734141da0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f571c00eb30 tx=0x7f571c009e10 comp rx=0 tx=0).stop 2024-04-27T02:39:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 shutdown_connections 2024-04-27T02:39:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f571006c8f0 0x7f571006edb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5734144fa0 0x7f57341422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5734144b40 0x7f5734141da0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 --2- 172.21.15.16:0/1405740336 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f5718003b90 0x7f57340b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 >> 172.21.15.16:0/1405740336 conn(0x7f573409fc60 msgr2=0x7f57340a0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 shutdown_connections 2024-04-27T02:39:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.703+0000 7f5739e00640 1 -- 172.21.15.16:0/1405740336 wait complete. 2024-04-27T02:39:07.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-27T02:39:07.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.917+0000 7fc2de400640 1 Processor -- start 2024-04-27T02:39:07.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.917+0000 7fc2de400640 1 -- start start 2024-04-27T02:39:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.919+0000 7fc2de400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d80b6a90 0x7fc2d80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.919+0000 7fc2de400640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2d80b0fe0 0x7fc2d80b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.919+0000 7fc2de400640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d80b6e70 con 0x7fc2d80b1a30 2024-04-27T02:39:07.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.919+0000 7fc2de400640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80b1560 con 0x7fc2d80b0fe0 2024-04-27T02:39:07.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.919+0000 7fc2de400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d80b3b30 con 0x7fc2d80b6a90 2024-04-27T02:39:07.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.920+0000 7fc2dd000640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d80b6a90 0x7fc2d80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.920+0000 7fc2d7e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc2d80b0fe0 0x7fc2d80b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.920+0000 7fc2dda00640 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc2d80b1a30 0x7fc2d81465e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.16:37784/0 (socket says 172.21.15.16:37784) 2024-04-27T02:39:07.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.920+0000 7fc2dda00640 1 -- 172.21.15.16:0/1744475739 learned_addr learned my addr 172.21.15.16:0/1744475739 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:39:07.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.920+0000 7fc2d7400640 1 -- 172.21.15.16:0/1744475739 <== mon.1 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599340585 0 0) 0x7fc2d80b6e70 con 0x7fc2d80b1a30 2024-04-27T02:39:07.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.920+0000 7fc2d7400640 1 -- 172.21.15.16:0/1744475739 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2c0003520 con 0x7fc2d80b1a30 2024-04-27T02:39:07.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.921+0000 7fc2dd000640 1 -- 172.21.15.16:0/1744475739 >> v2:172.21.15.32:3300/0 conn(0x7fc2d80b0fe0 msgr2=0x7fc2d80b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:07.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.921+0000 7fc2dd000640 1 --2- 172.21.15.16:0/1744475739 >> v2:172.21.15.32:3300/0 conn(0x7fc2d80b0fe0 0x7fc2d80b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.921+0000 7fc2dd000640 1 -- 172.21.15.16:0/1744475739 >> v1:172.21.15.32:6789/0 conn(0x7fc2d80b1a30 legacy=0x7fc2d81465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.921+0000 7fc2dd000640 1 -- 172.21.15.16:0/1744475739 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d80b6300 con 0x7fc2d80b6a90 2024-04-27T02:39:07.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.921+0000 7fc2d7e00640 1 --2- 172.21.15.16:0/1744475739 >> v2:172.21.15.32:3300/0 conn(0x7fc2d80b0fe0 0x7fc2d80b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T02:39:07.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.922+0000 7fc2dd000640 1 --2- 172.21.15.16:0/1744475739 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d80b6a90 0x7fc2d80b1e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097a0 tx=0x7fc2cc02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd7884d5f0d60ce server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:07.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.922+0000 7fc2d7400640 1 -- 172.21.15.16:0/1744475739 <== mon.2 v2:172.21.15.32:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc037070 con 0x7fc2d80b6a90 2024-04-27T02:39:07.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.922+0000 7fc2d7400640 1 -- 172.21.15.16:0/1744475739 <== mon.2 v2:172.21.15.32:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc2cc02adb0 con 0x7fc2d80b6a90 2024-04-27T02:39:07.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.922+0000 7fc2d7400640 1 -- 172.21.15.16:0/1744475739 <== mon.2 v2:172.21.15.32:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc032680 con 0x7fc2d80b6a90 2024-04-27T02:39:07.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.923+0000 7fc2de400640 1 -- 172.21.15.16:0/1744475739 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d80b6a90 msgr2=0x7fc2d80b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.923+0000 7fc2de400640 1 --2- 172.21.15.16:0/1744475739 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d80b6a90 0x7fc2d80b1e40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0097a0 tx=0x7fc2cc02a060 comp rx=0 tx=0).stop 2024-04-27T02:39:07.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.923+0000 7fc2de400640 1 -- 172.21.15.16:0/1744475739 shutdown_connections 2024-04-27T02:39:07.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.923+0000 7fc2de400640 1 --2- 172.21.15.16:0/1744475739 >> v2:172.21.15.32:3300/0 conn(0x7fc2d80b0fe0 0x7fc2d80b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.923+0000 7fc2de400640 1 --2- 172.21.15.16:0/1744475739 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d80b6a90 0x7fc2d80b1e40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.923+0000 7fc2de400640 1 -- 172.21.15.16:0/1744475739 >> 172.21.15.16:0/1744475739 conn(0x7fc2d8068270 msgr2=0x7fc2d8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:07.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.923+0000 7fc2de400640 1 -- 172.21.15.16:0/1744475739 shutdown_connections 2024-04-27T02:39:07.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.924+0000 7fc2de400640 1 -- 172.21.15.16:0/1744475739 wait complete. 2024-04-27T02:39:07.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.925+0000 7fc2de400640 1 Processor -- start 2024-04-27T02:39:07.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.925+0000 7fc2de400640 1 -- start start 2024-04-27T02:39:07.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.926+0000 7fc2de400640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2d80b0fe0 0x7fc2d8072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.926+0000 7fc2de400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b6a90 0x7fc2d81346a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.926+0000 7fc2de400640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d8137210 0x7fc2d81e2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.926+0000 7fc2de400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8157150 con 0x7fc2d80b6a90 2024-04-27T02:39:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.926+0000 7fc2de400640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8156fd0 con 0x7fc2d80b0fe0 2024-04-27T02:39:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.926+0000 7fc2de400640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d81572d0 con 0x7fc2d8137210 2024-04-27T02:39:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b6a90 0x7fc2d81346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b6a90 0x7fc2d81346a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36618/0 (socket says 172.21.15.16:36618) 2024-04-27T02:39:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 -- 172.21.15.16:0/3209272280 learned_addr learned my addr 172.21.15.16:0/3209272280 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:07.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2dd000640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2d80b0fe0 0x7fc2d8072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d8137210 0x7fc2d81e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 -- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d8137210 msgr2=0x7fc2d81e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d8137210 0x7fc2d81e2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 -- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2d80b0fe0 msgr2=0x7fc2d8072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:07.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2d80b0fe0 0x7fc2d8072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:07.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 -- 172.21.15.16:0/3209272280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d81352c0 con 0x7fc2d80b6a90 2024-04-27T02:39:07.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.927+0000 7fc2d7e00640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b6a90 0x7fc2d81346a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400e9b0 tx=0x7fc2c400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:07.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.928+0000 7fc2d4c00640 1 -- 172.21.15.16:0/3209272280 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4017070 con 0x7fc2d80b6a90 2024-04-27T02:39:07.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.928+0000 7fc2d4c00640 1 -- 172.21.15.16:0/3209272280 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc2c400ca00 con 0x7fc2d80b6a90 2024-04-27T02:39:07.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.928+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d8136a10 con 0x7fc2d80b6a90 2024-04-27T02:39:07.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.928+0000 7fc2d4c00640 1 -- 172.21.15.16:0/3209272280 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c400ce10 con 0x7fc2d80b6a90 2024-04-27T02:39:07.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.928+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d81e2a80 con 0x7fc2d80b6a90 2024-04-27T02:39:07.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.929+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d80b1820 con 0x7fc2d80b6a90 2024-04-27T02:39:07.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.930+0000 7fc2d4c00640 1 -- 172.21.15.16:0/3209272280 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2c401a070 con 0x7fc2d80b6a90 2024-04-27T02:39:07.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.932+0000 7fc2d4c00640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc2b806c8f0 0x7fc2b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:07.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.932+0000 7fc2d4c00640 1 -- 172.21.15.16:0/3209272280 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7fc2c408bb60 con 0x7fc2d80b6a90 2024-04-27T02:39:07.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.933+0000 7fc2dd000640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc2b806c8f0 0x7fc2b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:07.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.934+0000 7fc2dd000640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc2b806c8f0 0x7fc2b806edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc034000 tx=0x7fc2cc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:07.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:07.937+0000 7fc2d4c00640 1 -- 172.21.15.16:0/3209272280 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc2d80b1820 con 0x7fc2d80b6a90 2024-04-27T02:39:08.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.143+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2d8076600 con 0x7fc2d80b6a90 2024-04-27T02:39:08.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.144+0000 7fc2d4c00640 1 -- 172.21.15.16:0/3209272280 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16610 (secure 0 0 0) 0x7fc2c4059f70 con 0x7fc2d80b6a90 2024-04-27T02:39:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-27T02:39:08.119 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"c4a2c47f-b69d-4b6d-9f47-d97d07ce1d5a","created":"2024-04-26T23:34:26.484006+0000","modified":"2024-04-26T23:35:33.285268+0000","last_up_change":"2024-04-26T23:34:38.534416+0000","last_in_change":"2024-04-26T23:34:29.887762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:34:39.843396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:34:43.895977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:34:44.517438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf877757-9a6e-4afe-ac7e-74d7e0c75ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6809","nonce":2273435597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6811","nonce":2273435597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6815","nonce":2273435597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2273435597},{"type":"v1","addr":"172.21.15.16:6813","nonce":2273435597}]},"public_addr":"172.21.15.16:6809/2273435597","cluster_addr":"172.21.15.16:6811/2273435597","heartbeat_back_addr":"172.21.15.16:6815/2273435597","heartbeat_front_addr":"172.21.15.16:6813/2273435597","state":["exists","up"]},{"osd":1,"uuid":"a7169ab0-32fc-4276-9979-76aee7521000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6801","nonce":1499959106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6803","nonce":1499959106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6807","nonce":1499959106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1499959106},{"type":"v1","addr":"172.21.15.16:6805","nonce":1499959106}]},"public_addr":"172.21.15.16:6801/1499959106","cluster_addr":"172.21.15.16:6803/1499959106","heartbeat_back_addr":"172.21.15.16:6807/1499959106","heartbeat_front_addr":"172.21.15.16:6805/1499959106","state":["exists","up"]},{"osd":2,"uuid":"b7bbf2fa-2955-4531-973a-043a0731a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6817","nonce":1958514319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6819","nonce":1958514319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6823","nonce":1958514319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1958514319},{"type":"v1","addr":"172.21.15.16:6821","nonce":1958514319}]},"public_addr":"172.21.15.16:6817/1958514319","cluster_addr":"172.21.15.16:6819/1958514319","heartbeat_back_addr":"172.21.15.16:6823/1958514319","heartbeat_front_addr":"172.21.15.16:6821/1958514319","state":["exists","up"]},{"osd":3,"uuid":"a29d29a9-7ff8-4830-a841-b5d45f03e19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6825","nonce":882010783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6827","nonce":882010783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6831","nonce":882010783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":882010783},{"type":"v1","addr":"172.21.15.16:6829","nonce":882010783}]},"public_addr":"172.21.15.16:6825/882010783","cluster_addr":"172.21.15.16:6827/882010783","heartbeat_back_addr":"172.21.15.16:6831/882010783","heartbeat_front_addr":"172.21.15.16:6829/882010783","state":["exists","up"]},{"osd":4,"uuid":"2cdbea5e-f1c8-4868-a924-ad749b7d5404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6825","nonce":1044755861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6827","nonce":1044755861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6831","nonce":1044755861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1044755861},{"type":"v1","addr":"172.21.15.32:6829","nonce":1044755861}]},"public_addr":"172.21.15.32:6825/1044755861","cluster_addr":"172.21.15.32:6827/1044755861","heartbeat_back_addr":"172.21.15.32:6831/1044755861","heartbeat_front_addr":"172.21.15.32:6829/1044755861","state":["exists","up"]},{"osd":5,"uuid":"e4016ab4-d42a-4b8d-940e-9fc6dcd6f2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6801","nonce":2551335991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6803","nonce":2551335991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6807","nonce":2551335991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":2551335991},{"type":"v1","addr":"172.21.15.32:6805","nonce":2551335991}]},"public_addr":"172.21.15.32:6801/2551335991","cluster_addr":"172.21.15.32:6803/2551335991","heartbeat_back_addr":"172.21.15.32:6807/2551335991","heartbeat_front_addr":"172.21.15.32:6805/2551335991","state":["exists","up"]},{"osd":6,"uuid":"5430be5e-05be-4f71-a48e-8e295ec43476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6817","nonce":2056422341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6819","nonce":2056422341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6823","nonce":2056422341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2056422341},{"type":"v1","addr":"172.21.15.32:6821","nonce":2056422341}]},"public_addr":"172.21.15.32:6817/2056422341","cluster_addr":"172.21.15.32:6819/2056422341","heartbeat_back_addr":"172.21.15.32:6823/2056422341","heartbeat_front_addr":"172.21.15.32:6821/2056422341","state":["exists","up"]},{"osd":7,"uuid":"e7fdc82b-772b-4633-bff6-777d58014535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6809","nonce":4001400243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6811","nonce":4001400243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6815","nonce":4001400243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":4001400243},{"type":"v1","addr":"172.21.15.32:6813","nonce":4001400243}]},"public_addr":"172.21.15.32:6809/4001400243","cluster_addr":"172.21.15.32:6811/4001400243","heartbeat_back_addr":"172.21.15.32:6815/4001400243","heartbeat_front_addr":"172.21.15.32:6813/4001400243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.487930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.351164+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335367+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.402193+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.322791+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.335365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.252494+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:34:35.224884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T02:39:08.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc2b806c8f0 msgr2=0x7fc2b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc2b806c8f0 0x7fc2b806edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc034000 tx=0x7fc2cc02e000 comp rx=0 tx=0).stop 2024-04-27T02:39:08.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b6a90 msgr2=0x7fc2d81346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b6a90 0x7fc2d81346a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400e9b0 tx=0x7fc2c400ee70 comp rx=0 tx=0).stop 2024-04-27T02:39:08.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 shutdown_connections 2024-04-27T02:39:08.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fc2b806c8f0 0x7fc2b806edb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fc2d8137210 0x7fc2d81e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b6a90 0x7fc2d81346a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 --2- 172.21.15.16:0/3209272280 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc2d80b0fe0 0x7fc2d8072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.147+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 >> 172.21.15.16:0/3209272280 conn(0x7fc2d8068270 msgr2=0x7fc2d814ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:08.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.148+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 shutdown_connections 2024-04-27T02:39:08.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.148+0000 7fc2de400640 1 -- 172.21.15.16:0/3209272280 wait complete. 2024-04-27T02:39:08.140 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-27T02:39:08.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.376+0000 7f359fc00640 1 Processor -- start 2024-04-27T02:39:08.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.376+0000 7f359fc00640 1 -- start start 2024-04-27T02:39:08.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.377+0000 7f359fc00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 0x7f35980b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.377+0000 7f359fc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359806e710 con 0x7f359806e330 2024-04-27T02:39:08.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.377+0000 7f359fc00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35980b63d0 con 0x7f3598140220 2024-04-27T02:39:08.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.377+0000 7f359fc00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f35980b1ec0 con 0x7f35980b37a0 2024-04-27T02:39:08.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.377+0000 7f359d200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f359806e330 0x7f3598073860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53570/0 (socket says 172.21.15.16:53570) 2024-04-27T02:39:08.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.377+0000 7f359d200640 1 -- 172.21.15.16:0/3785991190 learned_addr learned my addr 172.21.15.16:0/3785991190 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:39:08.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597e00640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 0x7f35980b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476750364 0 0) 0x7f359806e710 con 0x7f359806e330 2024-04-27T02:39:08.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3580003520 con 0x7f359806e330 2024-04-27T02:39:08.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 310940330 0 0) 0x7f3580003520 con 0x7f359806e330 2024-04-27T02:39:08.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 msgr2=0x7f35980b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:08.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 0x7f35980b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 >> v1:172.21.15.32:6789/0 conn(0x7f3598140220 legacy=0x7f35981406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35980b1870 con 0x7f359806e330 2024-04-27T02:39:08.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f358c001670 con 0x7f359806e330 2024-04-27T02:39:08.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 >> v1:172.21.15.16:6789/0 conn(0x7f359806e330 legacy=0x7f3598073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35800039e0 0x7f3580003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3580004800 0x7f3580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 0x7f358000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35980b1ec0 con 0x7f3580004800 2024-04-27T02:39:08.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f3580005520 con 0x7f35800039e0 2024-04-27T02:39:08.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f358000bf00 con 0x7f35980b37a0 2024-04-27T02:39:08.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.378+0000 7f3597e00640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3580004800 0x7f3580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f359d200640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35800039e0 0x7f3580003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f359dc00640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 0x7f358000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f3597e00640 1 -- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 msgr2=0x7f358000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:08.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f3597e00640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35980b37a0 0x7f358000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f3597e00640 1 -- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35800039e0 msgr2=0x7f3580003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f3597e00640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35800039e0 0x7f3580003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f3597e00640 1 -- 172.21.15.16:0/3785991190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3580003520 con 0x7f3580004800 2024-04-27T02:39:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.379+0000 7f359d200640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35800039e0 0x7f3580003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:39:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.380+0000 7f3597e00640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3580004800 0x7f3580004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f358400ba30 tx=0x7f3580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23cd435062f29ed server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.380+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584030070 con 0x7f3580004800 2024-04-27T02:39:08.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.380+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f358402ade0 con 0x7f3580004800 2024-04-27T02:39:08.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.380+0000 7f3597400640 1 -- 172.21.15.16:0/3785991190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358400b600 con 0x7f3580004800 2024-04-27T02:39:08.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.381+0000 7f359fc00640 1 -- 172.21.15.16:0/3785991190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3580004800 msgr2=0x7f3580004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.381+0000 7f359fc00640 1 --2- 172.21.15.16:0/3785991190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3580004800 0x7f3580004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f358400ba30 tx=0x7f3580005830 comp rx=0 tx=0).stop 2024-04-27T02:39:08.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.381+0000 7f359dc00640 1 -- 172.21.15.16:0/3785991190 reap_dead start 2024-04-27T02:39:08.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.381+0000 7f359fc00640 1 -- 172.21.15.16:0/3785991190 shutdown_connections 2024-04-27T02:39:08.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.381+0000 7f359fc00640 1 -- 172.21.15.16:0/3785991190 >> 172.21.15.16:0/3785991190 conn(0x7f35980b6630 msgr2=0x7f35980b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:08.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.381+0000 7f359fc00640 1 -- 172.21.15.16:0/3785991190 shutdown_connections 2024-04-27T02:39:08.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.381+0000 7f359fc00640 1 -- 172.21.15.16:0/3785991190 wait complete. 2024-04-27T02:39:08.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.383+0000 7f359fc00640 1 Processor -- start 2024-04-27T02:39:08.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.383+0000 7f359fc00640 1 -- start start 2024-04-27T02:39:08.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359fc00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3580004800 0x7f3598145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359fc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598070420 0x7f35981ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359fc00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35981e1ec0 0x7f35980aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359fc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35980b3d60 con 0x7f3598070420 2024-04-27T02:39:08.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359fc00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f35980b3be0 con 0x7f3580004800 2024-04-27T02:39:08.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359fc00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f35980b3ee0 con 0x7f35981e1ec0 2024-04-27T02:39:08.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598070420 0x7f35981ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598070420 0x7f35981ddd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36636/0 (socket says 172.21.15.16:36636) 2024-04-27T02:39:08.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 -- 172.21.15.16:0/1890308306 learned_addr learned my addr 172.21.15.16:0/1890308306 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:08.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359d200640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3580004800 0x7f3598145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359dc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35981e1ec0 0x7f35980aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 -- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35981e1ec0 msgr2=0x7f35980aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35981e1ec0 0x7f35980aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 -- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3580004800 msgr2=0x7f3598145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3580004800 0x7f3598145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f3597e00640 1 -- 172.21.15.16:0/1890308306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3598070950 con 0x7f3598070420 2024-04-27T02:39:08.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.384+0000 7f359dc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35981e1ec0 0x7f35980aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:39:08.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.385+0000 7f3597e00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598070420 0x7f35981ddd40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f358400b950 tx=0x7f35840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:08.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.385+0000 7f3594c00640 1 -- 172.21.15.16:0/1890308306 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584043030 con 0x7f3598070420 2024-04-27T02:39:08.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.385+0000 7f3594c00640 1 -- 172.21.15.16:0/1890308306 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f358402abe0 con 0x7f3598070420 2024-04-27T02:39:08.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.385+0000 7f3594c00640 1 -- 172.21.15.16:0/1890308306 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358400b600 con 0x7f3598070420 2024-04-27T02:39:08.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.385+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35981e13e0 con 0x7f3598070420 2024-04-27T02:39:08.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.385+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35981de280 con 0x7f3598070420 2024-04-27T02:39:08.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.386+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35980693a0 con 0x7f3598070420 2024-04-27T02:39:08.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.387+0000 7f3594c00640 1 -- 172.21.15.16:0/1890308306 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3584046070 con 0x7f3598070420 2024-04-27T02:39:08.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.388+0000 7f3594c00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f357806c8f0 0x7f357806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.388+0000 7f3594c00640 1 -- 172.21.15.16:0/1890308306 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5738+0+0 (secure 0 0 0) 0x7f35840ac760 con 0x7f3598070420 2024-04-27T02:39:08.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.389+0000 7f359d200640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f357806c8f0 0x7f357806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.390+0000 7f359d200640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f357806c8f0 0x7f357806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f358c005bb0 tx=0x7f358c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:08.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.393+0000 7f3594c00640 1 -- 172.21.15.16:0/1890308306 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f358407aa40 con 0x7f3598070420 2024-04-27T02:39:08.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.641+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f359813d270 con 0x7f3598070420 2024-04-27T02:39:08.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.645+0000 7f3594c00640 1 -- 172.21.15.16:0/1890308306 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f358407a340 con 0x7f3598070420 2024-04-27T02:39:08.619 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-27T02:39:08.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f357806c8f0 msgr2=0x7f357806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f357806c8f0 0x7f357806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f358c005bb0 tx=0x7f358c009040 comp rx=0 tx=0).stop 2024-04-27T02:39:08.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598070420 msgr2=0x7f35981ddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598070420 0x7f35981ddd40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f358400b950 tx=0x7f35840046c0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 shutdown_connections 2024-04-27T02:39:08.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f357806c8f0 0x7f357806edb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f35981e1ec0 0x7f35980aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598070420 0x7f35981ddd40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 --2- 172.21.15.16:0/1890308306 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3580004800 0x7f3598145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 >> 172.21.15.16:0/1890308306 conn(0x7f35980b6630 msgr2=0x7f359813c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:08.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 shutdown_connections 2024-04-27T02:39:08.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.648+0000 7f359fc00640 1 -- 172.21.15.16:0/1890308306 wait complete. 2024-04-27T02:39:08.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-27T02:39:08.743 INFO:tasks.ceph.mds.b.smithi032.stdout:starting mds.b at 2024-04-27T02:39:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.866+0000 7f13bbe00640 1 Processor -- start 2024-04-27T02:39:08.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.866+0000 7f13bbe00640 1 -- start start 2024-04-27T02:39:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.867+0000 7f13bbe00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f13bc09d200 0x7f13bc14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.867+0000 7f13bbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f13bc0b9340 0x7f13bc145720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bbe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13bc073a70 con 0x7f13bc073690 2024-04-27T02:39:08.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bbe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc14c1a0 con 0x7f13bc0b9340 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bbe00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc14c480 con 0x7f13bc09d200 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13baa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f13bc073690 0x7f13bc0b8c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53574/0 (socket says 172.21.15.16:53574) 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13baa00640 1 -- 172.21.15.16:0/1656062439 learned_addr learned my addr 172.21.15.16:0/1656062439 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bb400640 1 --2- 172.21.15.16:0/1656062439 >> v2:172.21.15.16:3300/0 conn(0x7f13bc0b9340 0x7f13bc145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13ba000640 1 -- 172.21.15.16:0/1656062439 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799056243 0 0) 0x7f13bc073a70 con 0x7f13bc073690 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13ba000640 1 -- 172.21.15.16:0/1656062439 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13a0003520 con 0x7f13bc073690 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13b3e00640 1 --2- 172.21.15.16:0/1656062439 >> v2:172.21.15.32:3300/0 conn(0x7f13bc09d200 0x7f13bc14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bb400640 1 -- 172.21.15.16:0/1656062439 >> v2:172.21.15.32:3300/0 conn(0x7f13bc09d200 msgr2=0x7f13bc14bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bb400640 1 --2- 172.21.15.16:0/1656062439 >> v2:172.21.15.32:3300/0 conn(0x7f13bc09d200 0x7f13bc14bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bb400640 1 -- 172.21.15.16:0/1656062439 >> v1:172.21.15.16:6789/0 conn(0x7f13bc073690 legacy=0x7f13bc0b8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13bb400640 1 -- 172.21.15.16:0/1656062439 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0ba3f0 con 0x7f13bc0b9340 2024-04-27T02:39:08.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.868+0000 7f13b3e00640 1 --2- 172.21.15.16:0/1656062439 >> v2:172.21.15.32:3300/0 conn(0x7f13bc09d200 0x7f13bc14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:39:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.869+0000 7f13bb400640 1 --2- 172.21.15.16:0/1656062439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc0b9340 0x7f13bc145720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0744c0 tx=0x7f13b402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83d2434eb365015 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.870+0000 7f13ba000640 1 -- 172.21.15.16:0/1656062439 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4007740 con 0x7f13bc0b9340 2024-04-27T02:39:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.870+0000 7f13ba000640 1 -- 172.21.15.16:0/1656062439 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f13b40078e0 con 0x7f13bc0b9340 2024-04-27T02:39:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.870+0000 7f13ba000640 1 -- 172.21.15.16:0/1656062439 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4007cd0 con 0x7f13bc0b9340 2024-04-27T02:39:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.870+0000 7f13bbe00640 1 -- 172.21.15.16:0/1656062439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc0b9340 msgr2=0x7f13bc145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.870+0000 7f13bbe00640 1 --2- 172.21.15.16:0/1656062439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc0b9340 0x7f13bc145720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0744c0 tx=0x7f13b402a5f0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.871+0000 7f13bbe00640 1 -- 172.21.15.16:0/1656062439 shutdown_connections 2024-04-27T02:39:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.871+0000 7f13bbe00640 1 --2- 172.21.15.16:0/1656062439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc0b9340 0x7f13bc145720 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.871+0000 7f13bbe00640 1 --2- 172.21.15.16:0/1656062439 >> v2:172.21.15.32:3300/0 conn(0x7f13bc09d200 0x7f13bc14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.871+0000 7f13bbe00640 1 -- 172.21.15.16:0/1656062439 >> 172.21.15.16:0/1656062439 conn(0x7f13bc0bdc10 msgr2=0x7f13bc0be020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.871+0000 7f13bbe00640 1 -- 172.21.15.16:0/1656062439 shutdown_connections 2024-04-27T02:39:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.871+0000 7f13bbe00640 1 -- 172.21.15.16:0/1656062439 wait complete. 2024-04-27T02:39:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.872+0000 7f13bbe00640 1 Processor -- start 2024-04-27T02:39:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.872+0000 7f13bbe00640 1 -- start start 2024-04-27T02:39:08.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13bbe00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc073690 0x7f13bc144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13bbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc09d200 0x7f13bc144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13bbe00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f13bc0b9340 0x7f13bc1e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13bbe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc146030 con 0x7f13bc09d200 2024-04-27T02:39:08.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13bbe00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc145eb0 con 0x7f13bc073690 2024-04-27T02:39:08.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13bbe00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc1461b0 con 0x7f13bc0b9340 2024-04-27T02:39:08.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13b3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc09d200 0x7f13bc144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.873+0000 7f13b3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc09d200 0x7f13bc144d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36648/0 (socket says 172.21.15.16:36648) 2024-04-27T02:39:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b3e00640 1 -- 172.21.15.16:0/991295047 learned_addr learned my addr 172.21.15.16:0/991295047 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b3e00640 1 -- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f13bc0b9340 msgr2=0x7f13bc1e1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b3e00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f13bc0b9340 0x7f13bc1e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b3e00640 1 -- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc073690 msgr2=0x7f13bc144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b3e00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc073690 0x7f13bc144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:08.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b3e00640 1 -- 172.21.15.16:0/991295047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0b1b30 con 0x7f13bc09d200 2024-04-27T02:39:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b3e00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc09d200 0x7f13bc144d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c7f0 tx=0x7f13a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b2a00640 1 -- 172.21.15.16:0/991295047 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4015070 con 0x7f13bc09d200 2024-04-27T02:39:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b2a00640 1 -- 172.21.15.16:0/991295047 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f13a4007820 con 0x7f13bc09d200 2024-04-27T02:39:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13b2a00640 1 -- 172.21.15.16:0/991295047 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4007c10 con 0x7f13bc09d200 2024-04-27T02:39:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.874+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc0b1e10 con 0x7f13bc09d200 2024-04-27T02:39:08.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.875+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc0a1740 con 0x7f13bc09d200 2024-04-27T02:39:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.876+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc076600 con 0x7f13bc09d200 2024-04-27T02:39:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.877+0000 7f13b2a00640 1 -- 172.21.15.16:0/991295047 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13a4018070 con 0x7f13bc09d200 2024-04-27T02:39:08.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.878+0000 7f13b2a00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f139806c920 0x7f139806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.878+0000 7f13b2a00640 1 -- 172.21.15.16:0/991295047 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5824+0+0 (secure 0 0 0) 0x7f13a408bac0 con 0x7f13bc09d200 2024-04-27T02:39:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.878+0000 7f13baa00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f139806c920 0x7f139806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:08.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.879+0000 7f13baa00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f139806c920 0x7f139806ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13ac000f60 tx=0x7f13ac0078f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:08.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:08.882+0000 7f13b2a00640 1 -- 172.21.15.16:0/991295047 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f13a4059e80 con 0x7f13bc09d200 2024-04-27T02:39:09.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.114+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f13bc09f850 con 0x7f13bc09d200 2024-04-27T02:39:09.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.718+0000 7f13b2a00640 1 -- 172.21.15.16:0/991295047 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f13a4059780 con 0x7f13bc09d200 2024-04-27T02:39:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f139806c920 msgr2=0x7f139806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f139806c920 0x7f139806ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13ac000f60 tx=0x7f13ac0078f0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc09d200 msgr2=0x7f13bc144d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc09d200 0x7f13bc144d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c7f0 tx=0x7f13a400ccb0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 shutdown_connections 2024-04-27T02:39:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f139806c920 0x7f139806ede0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f13bc0b9340 0x7f13bc1e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13bc09d200 0x7f13bc144d50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 --2- 172.21.15.16:0/991295047 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13bc073690 0x7f13bc144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 >> 172.21.15.16:0/991295047 conn(0x7f13bc0bdc10 msgr2=0x7f13bc0b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 shutdown_connections 2024-04-27T02:39:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.721+0000 7f13bbe00640 1 -- 172.21.15.16:0/991295047 wait complete. 2024-04-27T02:39:09.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-27T02:39:09.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.961+0000 7fa703e00640 1 Processor -- start 2024-04-27T02:39:09.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.961+0000 7fa703e00640 1 -- start start 2024-04-27T02:39:09.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.963+0000 7fa703e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 0x7fa7040af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.963+0000 7fa703e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7040b6cb0 con 0x7fa704148270 2024-04-27T02:39:09.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.963+0000 7fa703e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7040b5b90 con 0x7fa7040b3470 2024-04-27T02:39:09.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.963+0000 7fa703e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fa7040b5940 con 0x7fa7040b68d0 2024-04-27T02:39:09.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.963+0000 7fa703400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa704148270 0x7fa704148720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53590/0 (socket says 172.21.15.16:53590) 2024-04-27T02:39:09.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.963+0000 7fa703400640 1 -- 172.21.15.16:0/861666026 learned_addr learned my addr 172.21.15.16:0/861666026 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:39:09.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.963+0000 7fa702a00640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 0x7fa7040af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707777011 0 0) 0x7fa7040b6cb0 con 0x7fa704148270 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e8003520 con 0x7fa704148270 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3762152341 0 0) 0x7fa6e8003520 con 0x7fa704148270 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 msgr2=0x7fa7040af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 0x7fa7040af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 >> v1:172.21.15.32:6789/0 conn(0x7fa7040b3470 legacy=0x7fa7040b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7040afbe0 con 0x7fa704148270 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7fa6fc0019f0 con 0x7fa704148270 2024-04-27T02:39:09.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 >> v1:172.21.15.16:6789/0 conn(0x7fa704148270 legacy=0x7fa704148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 0x7fa6e80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6e8003f20 0x7fa6e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa6e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040b5940 con 0x7fa6e8004d40 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e800bb80 con 0x7fa6e8003f20 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.964+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e800bd80 con 0x7fa7040b68d0 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa703400640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa6e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa702a00640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 0x7fa6e80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa702000640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6e8003f20 0x7fa6e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa703400640 1 -- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 msgr2=0x7fa6e80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:09.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa703400640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7040b68d0 0x7fa6e80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa703400640 1 -- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6e8003f20 msgr2=0x7fa6e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:09.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa703400640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6e8003f20 0x7fa6e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.965+0000 7fa703400640 1 -- 172.21.15.16:0/861666026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e8003520 con 0x7fa6e8004d40 2024-04-27T02:39:09.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.966+0000 7fa703400640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa6e80051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00a860 tx=0x7fa6e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3a62b2a9649cf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:09.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.966+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00a480 con 0x7fa6e8004d40 2024-04-27T02:39:09.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.966+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa6fc02f070 con 0x7fa6e8004d40 2024-04-27T02:39:09.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.966+0000 7fa701600640 1 -- 172.21.15.16:0/861666026 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc02bd10 con 0x7fa6e8004d40 2024-04-27T02:39:09.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.967+0000 7fa703e00640 1 -- 172.21.15.16:0/861666026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 msgr2=0x7fa6e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:09.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.967+0000 7fa703e00640 1 --2- 172.21.15.16:0/861666026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa6e80051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00a860 tx=0x7fa6e8005830 comp rx=0 tx=0).stop 2024-04-27T02:39:09.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.967+0000 7fa703400640 1 -- 172.21.15.16:0/861666026 reap_dead start 2024-04-27T02:39:09.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.967+0000 7fa703e00640 1 -- 172.21.15.16:0/861666026 shutdown_connections 2024-04-27T02:39:09.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.967+0000 7fa703e00640 1 -- 172.21.15.16:0/861666026 >> 172.21.15.16:0/861666026 conn(0x7fa704068270 msgr2=0x7fa704068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:09.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.967+0000 7fa703e00640 1 -- 172.21.15.16:0/861666026 shutdown_connections 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.967+0000 7fa703e00640 1 -- 172.21.15.16:0/861666026 wait complete. 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.969+0000 7fa703e00640 1 Processor -- start 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.969+0000 7fa703e00640 1 -- start start 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa703e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa704145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa703e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7041ce640 0x7fa7041dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa703e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7041ddf30 0x7fa7041e0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa703e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040b07d0 con 0x7fa6e8004d40 2024-04-27T02:39:09.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa703e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7fa7040b5f00 con 0x7fa7041ddf30 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa703e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7fa7040af6a0 con 0x7fa7041ce640 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa702a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa704145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa702a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa704145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36670/0 (socket says 172.21.15.16:36670) 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.970+0000 7fa702a00640 1 -- 172.21.15.16:0/4152004824 learned_addr learned my addr 172.21.15.16:0/4152004824 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa703400640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7041ddf30 0x7fa7041e0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa702000640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7041ce640 0x7fa7041dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa702a00640 1 -- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7041ce640 msgr2=0x7fa7041dd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa702a00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7041ce640 0x7fa7041dd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa702a00640 1 -- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7041ddf30 msgr2=0x7fa7041e0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa702a00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7041ddf30 0x7fa7041e0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa702a00640 1 -- 172.21.15.16:0/4152004824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7041de3c0 con 0x7fa6e8004d40 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa702a00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa704145020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4011600 tx=0x7fa6f4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa6faa00640 1 -- 172.21.15.16:0/4152004824 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400f8c0 con 0x7fa6e8004d40 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa6faa00640 1 -- 172.21.15.16:0/4152004824 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa6f400fa60 con 0x7fa6e8004d40 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.971+0000 7fa6faa00640 1 -- 172.21.15.16:0/4152004824 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400fe30 con 0x7fa6e8004d40 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.972+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7040726f0 con 0x7fa6e8004d40 2024-04-27T02:39:09.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.972+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa704072990 con 0x7fa6e8004d40 2024-04-27T02:39:09.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.973+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7040b70a0 con 0x7fa6e8004d40 2024-04-27T02:39:09.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.974+0000 7fa6faa00640 1 -- 172.21.15.16:0/4152004824 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6f4015460 con 0x7fa6e8004d40 2024-04-27T02:39:09.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.975+0000 7fa6faa00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa6e406c8f0 0x7fa6e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:09.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.975+0000 7fa6faa00640 1 -- 172.21.15.16:0/4152004824 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5824+0+0 (secure 0 0 0) 0x7fa6f408c450 con 0x7fa6e8004d40 2024-04-27T02:39:09.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.975+0000 7fa702000640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa6e406c8f0 0x7fa6e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:09.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.976+0000 7fa702000640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa6e406c8f0 0x7fa6e406edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa7041cea80 tx=0x7fa6f0007c50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:09.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:09.980+0000 7fa6faa00640 1 -- 172.21.15.16:0/4152004824 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa7040b70a0 con 0x7fa6e8004d40 2024-04-27T02:39:10.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.187+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa704076600 con 0x7fa6e8004d40 2024-04-27T02:39:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.730+0000 7fa6faa00640 1 -- 172.21.15.16:0/4152004824 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7fa6f4019030 con 0x7fa6e8004d40 2024-04-27T02:39:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-04-27T02:39:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa6e406c8f0 msgr2=0x7fa6e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa6e406c8f0 0x7fa6e406edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa7041cea80 tx=0x7fa6f0007c50 comp rx=0 tx=0).stop 2024-04-27T02:39:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 msgr2=0x7fa704145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa704145020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4011600 tx=0x7fa6f4011ac0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 shutdown_connections 2024-04-27T02:39:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7fa6e406c8f0 0x7fa6e406edb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7041ddf30 0x7fa7041e0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7fa7041ce640 0x7fa7041dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 --2- 172.21.15.16:0/4152004824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6e8004d40 0x7fa704145020 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.734+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 >> 172.21.15.16:0/4152004824 conn(0x7fa704068270 msgr2=0x7fa7040b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.735+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 shutdown_connections 2024-04-27T02:39:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.735+0000 7fa703e00640 1 -- 172.21.15.16:0/4152004824 wait complete. 2024-04-27T02:39:10.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-27T02:39:10.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.984+0000 7f10f6e00640 1 Processor -- start 2024-04-27T02:39:10.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.984+0000 7f10f6e00640 1 -- start start 2024-04-27T02:39:10.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.985+0000 7f10f6e00640 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10f0148bd0 0x7f10f0153d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.985+0000 7f10f6e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f009be80 con 0x7f10f009ba20 2024-04-27T02:39:10.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.985+0000 7f10f6e00640 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f00a0660 con 0x7f10f00a0280 2024-04-27T02:39:10.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.985+0000 7f10f6e00640 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 -- 0x7f10f0142ca0 con 0x7f10f0148bd0 2024-04-27T02:39:10.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.985+0000 7f10f5000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f10f009ba20 0x7f10f01484c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53596/0 (socket says 172.21.15.16:53596) 2024-04-27T02:39:10.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.985+0000 7f10f5000640 1 -- 172.21.15.16:0/249827672 learned_addr learned my addr 172.21.15.16:0/249827672 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-27T02:39:10.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10f6400640 1 --2- 172.21.15.16:0/249827672 >> v2:172.21.15.32:3300/0 conn(0x7f10f0148bd0 0x7f10f0153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:10.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768663222 0 0) 0x7f10f009be80 con 0x7f10f009ba20 2024-04-27T02:39:10.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d8003520 con 0x7f10f009ba20 2024-04-27T02:39:10.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 234833736 0 0) 0x7f10d8003520 con 0x7f10f009ba20 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 >> v2:172.21.15.32:3300/0 conn(0x7f10f0148bd0 msgr2=0x7f10f0153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 --2- 172.21.15.16:0/249827672 >> v2:172.21.15.32:3300/0 conn(0x7f10f0148bd0 0x7f10f0153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 >> v1:172.21.15.32:6789/0 conn(0x7f10f00a0280 legacy=0x7f10f0142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f00bd030 con 0x7f10f009ba20 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3695694238 0 0) 0x7f10dc001670 con 0x7f10f009ba20 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 >> v1:172.21.15.16:6789/0 conn(0x7f10f009ba20 legacy=0x7f10f01484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10d80039b0 0x7f10d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d8004800 0x7f10d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80051c0 0x7f10d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10d800c0e0 con 0x7f10d80039b0 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f10d800c290 con 0x7f10d80051c0 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f10d800c490 con 0x7f10d8004800 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.986+0000 7f10f6400640 1 --2- 172.21.15.16:0/249827672 >> v2:172.21.15.32:3300/0 conn(0x7f10f0148bd0 0x7f10f0153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.987+0000 7f10f5a00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10d80039b0 0x7f10d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.987+0000 7f10f5a00640 1 -- 172.21.15.16:0/249827672 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d8004800 msgr2=0x7f10d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.987+0000 7f10f5a00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d8004800 0x7f10d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.987+0000 7f10f5a00640 1 -- 172.21.15.16:0/249827672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80051c0 msgr2=0x7f10d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-27T02:39:10.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.987+0000 7f10f5a00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10d80051c0 0x7f10d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.987+0000 7f10f5a00640 1 -- 172.21.15.16:0/249827672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d8003520 con 0x7f10d80039b0 2024-04-27T02:39:10.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.987+0000 7f10f6400640 1 -- 172.21.15.16:0/249827672 reap_dead start 2024-04-27T02:39:10.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.988+0000 7f10f5a00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10d80039b0 0x7f10d8003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f10e4001750 tx=0x7f10d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990a82f49e0f60c server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.988+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4001370 con 0x7f10d80039b0 2024-04-27T02:39:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.988+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f10e40052d0 con 0x7f10d80039b0 2024-04-27T02:39:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.988+0000 7f10efe00640 1 -- 172.21.15.16:0/249827672 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e402abe0 con 0x7f10d80039b0 2024-04-27T02:39:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.989+0000 7f10f6e00640 1 -- 172.21.15.16:0/249827672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10d80039b0 msgr2=0x7f10d8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.989+0000 7f10f6e00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10d80039b0 0x7f10d8003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f10e4001750 tx=0x7f10d8005830 comp rx=0 tx=0).stop 2024-04-27T02:39:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.989+0000 7f10f6e00640 1 -- 172.21.15.16:0/249827672 shutdown_connections 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.989+0000 7f10f6e00640 1 --2- 172.21.15.16:0/249827672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10d80039b0 0x7f10d8003dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.989+0000 7f10f6e00640 1 -- 172.21.15.16:0/249827672 >> 172.21.15.16:0/249827672 conn(0x7f10f00687b0 msgr2=0x7f10f009f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.989+0000 7f10f6e00640 1 -- 172.21.15.16:0/249827672 shutdown_connections 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.989+0000 7f10f6e00640 1 -- 172.21.15.16:0/249827672 wait complete. 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.990+0000 7f10f6e00640 1 Processor -- start 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.991+0000 7f10f6e00640 1 -- start start 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.991+0000 7f10f6e00640 1 --2- >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d80039b0 0x7f10f013d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.991+0000 7f10f6e00640 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10f00b5730 0x7f10f00b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.991+0000 7f10f6e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10f013bd20 0x7f10f013c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.991+0000 7f10f6e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10f009c090 con 0x7f10f013bd20 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.991+0000 7f10f6e00640 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00bd680 con 0x7f10f00b5730 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.991+0000 7f10f6e00640 1 -- --> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] -- mon_getmap magic: 0 -- 0x7f10f00bcc00 con 0x7f10d80039b0 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10f013bd20 0x7f10f013c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10f013bd20 0x7f10f013c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36688/0 (socket says 172.21.15.16:36688) 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 -- 172.21.15.16:0/2803664087 learned_addr learned my addr 172.21.15.16:0/2803664087 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f5a00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d80039b0 0x7f10f013d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 -- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d80039b0 msgr2=0x7f10f013d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f5000640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10f00b5730 0x7f10f00b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d80039b0 0x7f10f013d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 -- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10f00b5730 msgr2=0x7f10f00b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10f00b5730 0x7f10f00b5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 -- 172.21.15.16:0/2803664087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f00b6640 con 0x7f10f013bd20 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f5a00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d80039b0 0x7f10f013d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.992+0000 7f10f6400640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10f013bd20 0x7f10f013c1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f10f00bb600 tx=0x7f10e800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.993+0000 7f10ed600640 1 -- 172.21.15.16:0/2803664087 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e801a070 con 0x7f10f013bd20 2024-04-27T02:39:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.993+0000 7f10ed600640 1 -- 172.21.15.16:0/2803664087 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f10e800dca0 con 0x7f10f013bd20 2024-04-27T02:39:10.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.993+0000 7f10ed600640 1 -- 172.21.15.16:0/2803664087 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8003bd0 con 0x7f10f013bd20 2024-04-27T02:39:10.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.993+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f00b4ec0 con 0x7f10f013bd20 2024-04-27T02:39:10.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.993+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f00b3dd0 con 0x7f10f013bd20 2024-04-27T02:39:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.994+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f0076600 con 0x7f10f013bd20 2024-04-27T02:39:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.995+0000 7f10ed600640 1 -- 172.21.15.16:0/2803664087 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10e801d070 con 0x7f10f013bd20 2024-04-27T02:39:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.996+0000 7f10ed600640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f10d006c920 0x7f10d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:39:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.996+0000 7f10ed600640 1 -- 172.21.15.16:0/2803664087 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5386+0+0 (secure 0 0 0) 0x7f10e808ba20 con 0x7f10f013bd20 2024-04-27T02:39:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.997+0000 7f10f5a00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f10d006c920 0x7f10d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:39:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:10.998+0000 7f10f5a00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f10d006c920 0x7f10d006ede0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f10e4032000 tx=0x7f10e402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:39:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.001+0000 7f10ed600640 1 -- 172.21.15.16:0/2803664087 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f10e8010070 con 0x7f10f013bd20 2024-04-27T02:39:11.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.204+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f10f009f510 con 0x7f10f013bd20 2024-04-27T02:39:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.733+0000 7f10ed600640 1 -- 172.21.15.16:0/2803664087 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f10e8059f80 con 0x7f10f013bd20 2024-04-27T02:39:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f10d006c920 msgr2=0x7f10d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f10d006c920 0x7f10d006ede0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f10e4032000 tx=0x7f10e402e000 comp rx=0 tx=0).stop 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10f013bd20 msgr2=0x7f10f013c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10f013bd20 0x7f10f013c1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f10f00bb600 tx=0x7f10e800d4a0 comp rx=0 tx=0).stop 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 shutdown_connections 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:6832/1413279187,v1:172.21.15.32:6833/1413279187] conn(0x7f10d006c920 0x7f10d006ede0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10f00b5730 0x7f10f00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10f013bd20 0x7f10f013c1a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:11.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 --2- 172.21.15.16:0/2803664087 >> [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] conn(0x7f10d80039b0 0x7f10f013d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:39:11.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 >> 172.21.15.16:0/2803664087 conn(0x7f10f00687b0 msgr2=0x7f10f0142360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T02:39:11.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 shutdown_connections 2024-04-27T02:39:11.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-27T02:39:11.737+0000 7f10f6e00640 1 -- 172.21.15.16:0/2803664087 wait complete. 2024-04-27T02:39:11.742 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-27T02:39:11.742 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-27T02:39:11.742 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:11.765 INFO:tasks.ceph.mds.a:Stopped 2024-04-27T02:39:11.765 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-27T02:39:11.765 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:11.783 INFO:tasks.ceph.mds.b:Stopped 2024-04-27T02:39:11.784 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-27T02:39:11.784 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-27T02:39:11.784 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:11.882 INFO:tasks.ceph.osd.0:Stopped 2024-04-27T02:39:11.882 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-27T02:39:11.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:11.937 INFO:tasks.ceph.osd.1:Stopped 2024-04-27T02:39:11.937 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-27T02:39:11.937 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.024 INFO:tasks.ceph.osd.2:Stopped 2024-04-27T02:39:12.024 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-27T02:39:12.024 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.087 INFO:tasks.ceph.osd.3:Stopped 2024-04-27T02:39:12.087 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-27T02:39:12.088 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.155 INFO:tasks.ceph.osd.4:Stopped 2024-04-27T02:39:12.156 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-27T02:39:12.156 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.210 INFO:tasks.ceph.osd.5:Stopped 2024-04-27T02:39:12.211 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-27T02:39:12.211 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.286 INFO:tasks.ceph.osd.6:Stopped 2024-04-27T02:39:12.286 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-27T02:39:12.286 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.361 INFO:tasks.ceph.osd.7:Stopped 2024-04-27T02:39:12.361 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-27T02:39:12.361 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-27T02:39:12.361 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.457 INFO:tasks.ceph.mgr.y:Stopped 2024-04-27T02:39:12.458 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-27T02:39:12.458 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.544 INFO:tasks.ceph.mgr.x:Stopped 2024-04-27T02:39:12.545 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-27T02:39:12.545 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-27T02:39:12.545 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.619 INFO:tasks.ceph.mon.a:Stopped 2024-04-27T02:39:12.619 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-27T02:39:12.619 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.659 INFO:tasks.ceph.mon.b:Stopped 2024-04-27T02:39:12.660 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-27T02:39:12.660 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T02:39:12.733 INFO:tasks.ceph.mon.c:Stopped 2024-04-27T02:39:12.733 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-27T02:39:12.734 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-27T02:39:12.840 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-27T02:39:12.841 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-27T02:39:13.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-27T02:39:13.090 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-27T02:39:13.272 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-27T02:39:13.272 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-27T02:39:13.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-27T02:39:13.413 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-27T02:39:13.588 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-27T02:39:13.589 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-27T02:39:13.759 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-27T02:39:13.760 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-27T02:39:13.883 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-27T02:39:13.883 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-27T02:39:14.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi032.front.sepia.ceph.com 2024-04-27T02:39:14.020 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-27T02:39:14.155 INFO:tasks.ceph:Archiving mon data... 2024-04-27T02:39:14.157 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/data/mon.a.tgz 2024-04-27T02:39:14.157 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-27T02:39:14.218 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.Mhgd8gR5xh 2024-04-27T02:39:14.218 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Mhgd8gR5xh 2024-04-27T02:39:14.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.Mhgd8gR5xh 2024-04-27T02:39:14.537 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.Mhgd8gR5xh is 303KB 2024-04-27T02:39:14.650 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.Mhgd8gR5xh 2024-04-27T02:39:14.709 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/data/mon.b.tgz 2024-04-27T02:39:14.709 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-04-27T02:39:14.770 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.fvq4x2wBMd 2024-04-27T02:39:14.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fvq4x2wBMd 2024-04-27T02:39:14.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.fvq4x2wBMd 2024-04-27T02:39:15.081 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.fvq4x2wBMd is 305KB 2024-04-27T02:39:15.154 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.fvq4x2wBMd 2024-04-27T02:39:15.212 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/data/mon.c.tgz 2024-04-27T02:39:15.212 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-04-27T02:39:15.265 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.vGxG4kCDD2 2024-04-27T02:39:15.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vGxG4kCDD2 2024-04-27T02:39:15.416 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.vGxG4kCDD2 2024-04-27T02:39:15.547 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.vGxG4kCDD2 is 305KB 2024-04-27T02:39:15.651 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.vGxG4kCDD2 2024-04-27T02:39:15.711 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-27T02:39:15.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-27T02:39:15.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-27T02:39:15.861 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-27T02:39:15.922 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-27T02:39:15.922 INFO:tasks.ceph:Archiving crash dumps... 2024-04-27T02:39:15.924 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/remote/smithi016/crash 2024-04-27T02:39:15.925 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-27T02:39:16.015 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/remote/smithi032/crash 2024-04-27T02:39:16.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-27T02:39:16.106 INFO:tasks.ceph:Shutting down logrotate 2024-04-27T02:39:16.106 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:39:16.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-27T02:39:16.242 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-27T02:39:16.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-27T02:39:16.420 INFO:tasks.ceph:Compressing logs... 2024-04-27T02:39:16.420 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-27T02:39:16.428 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-27T02:39:16.507 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2024-04-27T02:39:16.508 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-27T02:39:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38921.log 2024-04-27T02:39:16.509 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33347.log 2024-04-27T02:39:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47891.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2024-04-27T02:39:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47623.log 2024-04-27T02:39:16.511 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38930.log 2024-04-27T02:39:16.512 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47623.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38921.log.gz 2024-04-27T02:39:16.512 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2024-04-27T02:39:16.512 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47623.log.gz 2024-04-27T02:39:16.512 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-27T02:39:16.512 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33347.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-27T02:39:16.513 INFO:teuthology.orchestra.run.smithi032.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33347.log.gz 2024-04-27T02:39:16.513 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-27T02:39:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.7.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-27T02:39:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-27T02:39:16.515 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39632.log 2024-04-27T02:39:16.515 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38930.log.gz 2024-04-27T02:39:16.515 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2024-04-27T02:39:16.515 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37910.log 2024-04-27T02:39:16.515 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47413.log 2024-04-27T02:39:16.515 INFO:teuthology.orchestra.run.smithi016.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39632.log.gz 2024-04-27T02:39:16.516 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39338.log 2024-04-27T02:39:16.517 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37910.log.gz 2024-04-27T02:39:16.517 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47413.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47413.log.gz -- 2024-04-27T02:39:16.517 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.39422.log 2024-04-27T02:39:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33216.log 2024-04-27T02:39:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-27T02:39:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33387.log 2024-04-27T02:39:16.518 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33216.log.gz 2024-04-27T02:39:16.519 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2024-04-27T02:39:16.519 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39422.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39338.log.gz 2024-04-27T02:39:16.519 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47707.log 2024-04-27T02:39:16.520 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39422.log.gz 2024-04-27T02:39:16.520 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40057.log 2024-04-27T02:39:16.520 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz 2024-04-27T02:39:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-27T02:39:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33387.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-27T02:39:16.522 INFO:teuthology.orchestra.run.smithi032.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33387.log.gz 2024-04-27T02:39:16.522 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47707.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47707.log.gz 2024-04-27T02:39:16.523 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48101.log 2024-04-27T02:39:16.523 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40057.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-27T02:39:16.523 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48101.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48101.log.gz 2024-04-27T02:39:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-27T02:39:16.524 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2024-04-27T02:39:16.524 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2024-04-27T02:39:16.525 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47119.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2024-04-27T02:39:16.526 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47371.log 2024-04-27T02:39:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33427.log 2024-04-27T02:39:16.527 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38932.log 2024-04-27T02:39:16.527 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47371.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2024-04-27T02:39:16.528 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47371.log.gz 2024-04-27T02:39:16.528 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-27T02:39:16.529 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37486.log 2024-04-27T02:39:16.529 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38932.log.gz 2024-04-27T02:39:16.530 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33467.log 2024-04-27T02:39:16.531 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37528.log 2024-04-27T02:39:16.532 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33307.log 2024-04-27T02:39:16.533 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38594.log 2024-04-27T02:39:16.533 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37486.log.gz 2024-04-27T02:39:16.534 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37528.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph.tmp-client.admin.27286.log -- replaced with /var/log/ceph/ceph-client.admin.37528.log.gz 2024-04-27T02:39:16.534 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-27T02:39:16.534 INFO:teuthology.orchestra.run.smithi016.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-27T02:39:16.535 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33427.log.gz 2024-04-27T02:39:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38243.log 2024-04-27T02:39:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.27286.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38594.log.gz 2024-04-27T02:39:16.536 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27286.log.gz 2024-04-27T02:39:16.537 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39296.log 2024-04-27T02:39:16.537 INFO:teuthology.orchestra.run.smithi032.stderr: 95.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-27T02:39:16.538 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33256.log 2024-04-27T02:39:16.539 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47287.log 2024-04-27T02:39:16.539 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39296.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38243.log.gz 2024-04-27T02:39:16.539 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39296.log.gz 2024-04-27T02:39:16.539 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38260.log 2024-04-27T02:39:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33307.log: 88.2% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33467.log.gz 2024-04-27T02:39:16.540 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33307.log.gz 2024-04-27T02:39:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47287.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-27T02:39:16.541 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38260.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47287.log.gz 2024-04-27T02:39:16.542 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38260.log.gz 2024-04-27T02:39:16.542 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39380.log 2024-04-27T02:39:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33507.log 2024-04-27T02:39:16.543 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38575.log 2024-04-27T02:39:16.544 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39380.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-27T02:39:16.544 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39380.log.gz 2024-04-27T02:39:16.545 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2024-04-27T02:39:16.546 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33507.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.33256.log.gz -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-27T02:39:16.546 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-04-27T02:39:16.547 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-27T02:39:16.547 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38575.log: /var/log/ceph/ceph-client.admin.47809.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38575.log.gz 2024-04-27T02:39:16.547 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2024-04-27T02:39:16.547 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33421.log 2024-04-27T02:39:16.548 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33507.log.gz 2024-04-27T02:39:16.548 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48143.log 2024-04-27T02:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33421.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33421.log.gz 2024-04-27T02:39:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37418.log 2024-04-27T02:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37700.log 2024-04-27T02:39:16.551 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48143.log.gz 2024-04-27T02:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37418.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37418.log.gz 2024-04-27T02:39:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-04-27T02:39:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37700.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-27T02:39:16.554 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37700.log.gz 2024-04-27T02:39:16.555 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37994.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz -5 2024-04-27T02:39:16.555 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-27T02:39:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2024-04-27T02:39:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39464.log 2024-04-27T02:39:16.559 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38864.log 2024-04-27T02:39:16.560 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz 2024-04-27T02:39:16.560 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39464.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39464.log.gz 2024-04-27T02:39:16.561 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37258.log 2024-04-27T02:39:16.561 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38864.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38864.log.gz 2024-04-27T02:39:16.562 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-27T02:39:16.564 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2024-04-27T02:39:16.564 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37258.log.gz 2024-04-27T02:39:16.565 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33154.log 2024-04-27T02:39:16.567 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38254.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2024-04-27T02:39:16.568 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33154.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.33154.log.gz 2024-04-27T02:39:16.569 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2024-04-27T02:39:16.570 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38258.log 2024-04-27T02:39:16.572 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47933.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-04-27T02:39:16.573 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38258.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38258.log.gz 2024-04-27T02:39:16.573 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46993.log 2024-04-27T02:39:16.575 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47665.log 2024-04-27T02:39:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46993.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46993.log.gz 2024-04-27T02:39:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47665.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47665.log.gz 2024-04-27T02:39:16.578 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38582.log 2024-04-27T02:39:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39590.log 2024-04-27T02:39:16.581 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38582.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38582.log.gz 2024-04-27T02:39:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39590.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39590.log.gz 2024-04-27T02:39:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38923.log 2024-04-27T02:39:16.585 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38849.log 2024-04-27T02:39:16.586 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38923.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38923.log.gz 2024-04-27T02:39:16.588 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38849.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38849.log.gz 2024-04-27T02:39:16.588 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2024-04-27T02:39:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47455.log 2024-04-27T02:39:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47245.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2024-04-27T02:39:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47455.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47455.log.gz 2024-04-27T02:39:16.593 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37196.log 2024-04-27T02:39:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47497.log 2024-04-27T02:39:16.596 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37196.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37196.log.gz 2024-04-27T02:39:16.597 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47497.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47497.log.gz 2024-04-27T02:39:16.598 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39170.log 2024-04-27T02:39:16.599 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37572.log 2024-04-27T02:39:16.601 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39170.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39170.log.gz 2024-04-27T02:39:16.602 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37572.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37572.log.gz 2024-04-27T02:39:16.603 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37868.log 2024-04-27T02:39:16.604 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-27T02:39:16.605 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37868.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37868.log.gz 2024-04-27T02:39:16.608 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39674.log 2024-04-27T02:39:16.609 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47749.log 2024-04-27T02:39:16.611 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39674.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39674.log.gz 2024-04-27T02:39:16.614 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47161.log 2024-04-27T02:39:16.614 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47749.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47749.log.gz 2024-04-27T02:39:16.616 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38596.log 2024-04-27T02:39:16.617 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47161.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47161.log.gz 2024-04-27T02:39:16.619 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2024-04-27T02:39:16.619 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38596.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38596.log.gz 2024-04-27T02:39:16.623 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48059.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2024-04-27T02:39:16.623 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39758.log 2024-04-27T02:39:16.626 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37616.log 2024-04-27T02:39:16.628 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38255.log 2024-04-27T02:39:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37616.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.39758.log.gz 2024-04-27T02:39:16.629 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37616.log.gz 2024-04-27T02:39:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38255.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38255.log.gz 2024-04-27T02:39:16.633 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-04-27T02:39:16.635 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-04-27T02:39:16.636 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-04-27T02:39:16.638 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46951.log 2024-04-27T02:39:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38589.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-04-27T02:39:16.642 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33522.log 2024-04-27T02:39:16.644 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46951.log.gz 2024-04-27T02:39:16.646 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38931.log 2024-04-27T02:39:16.650 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33522.log: 88.4%/var/log/ceph/ceph-client.admin.38931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38593.log 2024-04-27T02:39:16.651 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33522.log.gz 2024-04-27T02:39:16.652 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38931.log.gz 2024-04-27T02:39:16.653 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38927.log 2024-04-27T02:39:16.659 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38593.log: /var/log/ceph/ceph-client.admin.38927.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-04-27T02:39:16.659 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38593.log.gz 2024-04-27T02:39:16.659 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38927.log.gz 2024-04-27T02:39:16.660 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47203.log 2024-04-27T02:39:16.662 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46909.log 2024-04-27T02:39:16.666 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47539.log 2024-04-27T02:39:16.666 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47203.log: -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-04-27T02:39:16.666 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47203.log.gz 2024-04-27T02:39:16.668 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37952.log 2024-04-27T02:39:16.669 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46909.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46909.log.gz 2024-04-27T02:39:16.670 INFO:teuthology.orchestra.run.smithi016.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47539.log.gz 2024-04-27T02:39:16.672 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38078.log 2024-04-27T02:39:16.673 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37952.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37952.log.gz 2024-04-27T02:39:16.675 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38595.log 2024-04-27T02:39:16.678 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38595.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38078.log.gz 2024-04-27T02:39:16.679 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38245.log 2024-04-27T02:39:16.680 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38595.log.gz 2024-04-27T02:39:16.681 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2024-04-27T02:39:16.683 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38580.log 2024-04-27T02:39:16.686 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47077.log: /var/log/ceph/ceph-client.admin.38245.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2024-04-27T02:39:16.686 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38245.log.gz 2024-04-27T02:39:16.687 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6%/var/log/ceph/ceph-client.admin.38580.log: -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2024-04-27T02:39:16.690 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6%/var/log/ceph/ceph-client.admin.47975.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2024-04-27T02:39:16.690 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47329.log 2024-04-27T02:39:16.691 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38580.log.gz 2024-04-27T02:39:16.693 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37376.log 2024-04-27T02:39:16.694 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47329.log.gz 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-27T02:39:16.694 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-27T02:39:16.696 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37826.log 2024-04-27T02:39:16.697 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37376.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37376.log.gz 2024-04-27T02:39:16.698 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log/var/log/ceph/ceph-client.admin.37826.log: 2024-04-27T02:39:16.699 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37826.log.gz 2024-04-27T02:39:16.700 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39506.log 2024-04-27T02:39:16.701 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47581.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2024-04-27T02:39:16.703 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39212.log/var/log/ceph/ceph-client.admin.39506.log: 2024-04-27T02:39:16.703 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39506.log.gz 2024-04-27T02:39:16.704 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-27T02:39:16.706 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39212.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39212.log.gz 2024-04-27T02:39:16.706 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose/var/log/ceph/ceph-mds.a.log: -- /var/log/ceph/ceph-client.admin.39128.log 2024-04-27T02:39:16.708 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39254.log 2024-04-27T02:39:16.710 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39128.log.gz 2024-04-27T02:39:16.711 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38036.log 2024-04-27T02:39:16.716 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39254.log: /var/log/ceph/ceph-client.admin.38036.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-04-27T02:39:16.717 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39254.log.gz 2024-04-27T02:39:16.717 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38036.log.gz 2024-04-27T02:39:16.719 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37119.log 2024-04-27T02:39:16.724 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38249.log: /var/log/ceph/ceph-client.admin.37119.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2024-04-27T02:39:16.724 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-04-27T02:39:16.725 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37119.log.gz 2024-04-27T02:39:16.726 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37742.log 2024-04-27T02:39:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37784.log: /var/log/ceph/ceph-client.admin.37742.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2024-04-27T02:39:16.731 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2024-04-27T02:39:16.732 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37742.log.gz 2024-04-27T02:39:16.733 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38259.log 2024-04-27T02:39:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47849.log: /var/log/ceph/ceph-client.admin.38259.log: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.40057.log.gz 2024-04-27T02:39:16.738 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2024-04-27T02:39:16.738 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38259.log.gz 2024-04-27T02:39:16.749 INFO:teuthology.orchestra.run.smithi016.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-27T02:39:17.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.b.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-27T02:39:18.132 INFO:teuthology.orchestra.run.smithi032.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-27T02:39:19.137 INFO:teuthology.orchestra.run.smithi032.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-27T02:39:19.480 INFO:teuthology.orchestra.run.smithi016.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-27T02:39:19.531 INFO:teuthology.orchestra.run.smithi016.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-27T02:39:19.630 INFO:teuthology.orchestra.run.smithi032.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-27T02:39:19.707 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-27T02:39:20.007 INFO:teuthology.orchestra.run.smithi032.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-27T02:39:20.464 INFO:teuthology.orchestra.run.smithi016.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-27T02:39:20.498 INFO:teuthology.orchestra.run.smithi032.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-27T02:39:21.149 INFO:teuthology.orchestra.run.smithi032.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-27T02:39:21.154 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-04-27T02:39:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m4.676s 2024-04-27T02:39:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m22.070s 2024-04-27T02:39:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m1.780s 2024-04-27T02:39:21.325 INFO:teuthology.orchestra.run.smithi016.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-27T02:39:22.189 INFO:teuthology.orchestra.run.smithi016.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-27T02:39:22.193 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-27T02:39:22.193 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m5.717s 2024-04-27T02:39:22.193 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m19.199s 2024-04-27T02:39:22.194 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m1.767s 2024-04-27T02:39:22.195 INFO:tasks.ceph:Archiving logs... 2024-04-27T02:39:22.195 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/remote/smithi016/log 2024-04-27T02:39:22.196 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-27T02:39:25.156 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/remote/smithi032/log 2024-04-27T02:39:25.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-27T02:39:27.884 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-27T02:39:27.894 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-27T02:39:27.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-27T02:39:27.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-27T02:39:28.054 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-27T02:39:28.064 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-27T02:39:28.064 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-27T02:39:28.072 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-27T02:39:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-04-27T02:39:28.131 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 1: ntpq: command not found 2024-04-27T02:39:28.132 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-27T02:39:28.132 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-04-27T02:39:28.132 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 7 377 47 +2248us[+2251us] +/- 43ms 2024-04-27T02:39:28.133 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 185 -2928us[-2932us] +/- 57ms 2024-04-27T02:39:28.133 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +372us[ +375us] +/- 83ms 2024-04-27T02:39:28.133 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T02:39:28.141 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-27T02:39:28.141 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2024-04-27T02:39:28.141 INFO:teuthology.orchestra.run.smithi032.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +2166us[+2159us] +/- 42ms 2024-04-27T02:39:28.141 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 244 -2944us[-2764us] +/- 56ms 2024-04-27T02:39:28.142 INFO:teuthology.orchestra.run.smithi032.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 44 +364us[ +364us] +/- 83ms 2024-04-27T02:39:28.142 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T02:39:28.143 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-27T02:39:28.153 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-27T02:39:28.153 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-27T02:39:28.190 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-27T02:39:28.398 DEBUG:teuthology.orchestra.run.smithi032:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-27T02:39:28.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-27T02:39:28.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T02:39:28.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-27T02:39:28.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T02:39:28.793 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-27T02:39:28.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-27T02:39:28.852 INFO:teuthology.task.internal:Duration was 11671.120003 seconds 2024-04-27T02:39:28.852 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-27T02:39:28.902 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-27T02:39:28.903 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-27T02:39:28.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-27T02:39:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-27T02:39:29.056 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-27T02:39:29.590 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-27T02:39:29.590 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-04-27T02:39:29.590 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-27T02:39:29.668 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-04-27T02:39:29.668 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-27T02:39:29.743 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-27T02:39:29.743 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-27T02:39:29.750 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-27T02:39:29.831 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-27T02:39:29.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-27T02:39:29.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-27T02:39:30.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-27T02:39:30.120 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-27T02:39:30.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-27T02:39:30.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-27T02:39:30.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-27T02:39:30.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-27T02:39:30.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-27T02:39:30.416 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-04-27T02:39:30.420 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-04-27T02:39:30.472 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-27T02:39:30.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T02:39:30.525 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-27T02:39:30.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T02:39:30.583 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-27T02:39:30.597 INFO:teuthology.task.internal:Transferring archived files... 2024-04-27T02:39:30.597 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/remote/smithi016 2024-04-27T02:39:30.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-27T02:39:30.699 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311/remote/smithi032 2024-04-27T02:39:30.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-27T02:39:30.801 INFO:teuthology.task.internal:Removing archive directory... 2024-04-27T02:39:30.801 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-27T02:39:30.810 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-27T02:39:30.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-27T02:39:30.885 INFO:teuthology.task.internal:Not uploading archives. 2024-04-27T02:39:30.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-27T02:39:30.920 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-27T02:39:30.920 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-27T02:39:30.928 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-27T02:39:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 27 02:39 /home/ubuntu/cephtest 2024-04-27T02:39:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: 393407 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 26 23:35 /home/ubuntu/cephtest/mnt.0 2024-04-27T02:39:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: 393408 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 26 23:36 /home/ubuntu/cephtest/mnt.0/client.0 2024-04-27T02:39:30.980 INFO:teuthology.orchestra.run.smithi016.stdout: 418472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:36 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-27T02:39:30.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T02:39:30.982 INFO:teuthology.orchestra.run.smithi016.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-27T02:39:30.982 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-27T02:39:30.991 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-27T02:39:31.004 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-27T02:39:31.037 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi016 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-27T02:39:31.037 INFO:teuthology.nuke:Checking targets against current locks 2024-04-27T02:39:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 27 02:39 /home/ubuntu/cephtest 2024-04-27T02:39:31.067 DEBUG:teuthology.nuke:shortname: smithi016 2024-04-27T02:39:31.068 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-27T02:39:31.095 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:16:04.239083', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECypiMhzlZ9MqSitgmx1hZczrjFLHTKAjOedvVnrhbiBbTvQ0/PBniTWwgpgLNxSNTrUZvttS5i/UbVQHF/V8Q='} 2024-04-27T02:39:31.099 DEBUG:teuthology.nuke:shortname: smithi032 2024-04-27T02:39:31.099 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-27T02:39:31.125 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:16:04.241350', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDH0ZAMpSTmaRpnH7gb2q119fWEHliUitXaDJoRfb1WILdGZZ3plIsS95gWVIbfpcyXMjvkXcrulBhScuAs/9Y0='} 2024-04-27T02:39:31.152 INFO:teuthology.orchestra.console.smithi016:Power off 2024-04-27T02:39:31.152 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-27T02:39:31.182 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-04-27T02:39:31.182 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T02:39:31.198 INFO:teuthology.orchestra.console.smithi032:Power off 2024-04-27T02:39:31.198 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-27T02:39:31.207 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-27T02:39:31.219 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-04-27T02:39:31.219 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T02:39:31.242 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-04-27T02:39:35.208 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T02:39:35.244 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T02:39:35.319 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-27T02:39:35.354 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-04-27T02:39:39.322 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T02:39:39.355 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T02:39:39.431 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-27T02:39:39.464 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-04-27T02:39:39.532 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-04-27T02:39:43.466 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T02:39:43.576 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-04-27T02:39:43.677 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-04-27T02:39:43.783 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs_python} duration: 11671.120003461838 failure_reason: 'Command failed (workunit test fs/test_python.sh) on smithi016 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh''' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7a2a4869081c4874878ddb02649ac390 status: fail success: false 2024-04-27T02:39:43.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-27T02:39:43.866 INFO:teuthology.run:FAIL